Enhanced wearable device operation

Abstract

Determining a first horizontal axis of a plane of a display based on a user input. Collecting angular motion data of the display. Determining a second horizontal axis of the plane of the display based on the angular motion data. Mapping a second user input on the display based on the second horizontal axis.

Description

Technical Field

[0001] The invention relates to determining a first horizontal axis of a plane of a display based on a user input, collecting angular motion data of the display, determining a second horizontal axis of the plane of the display based on the angular motion data, and mapping a second user input on the display based on the second horizontal axis. Background Art

[0002] The wearable device may receive input from a user. Based on the input, the wearable device may generate instructions for the processor to perform a task. The input may be a manual input on a display of the wearable device. When the wearable device is worn on the user, the wearable device may move to one of a plurality of orientations. Different orientations based on the movement of the wearable device may cause problems in providing and receiving user input. Summary of the invention

[0003] A system includes a computer programmed to: determine a first horizontal axis of the plane of a display based on a user input; collect angular motion data of the display; determine a second horizontal axis of the plane of the display based on the angular motion data; and map a second user input on the display based on the second horizontal axis.

[0004] In the system, the computer may be further programmed to determine a rotation angle based on the angular motion data, and to determine the second horizontal axis based on the rotation angle.

[0005] The system wherein the computer may be further programmed to determine the angle of rotation based on an angular velocity about an axis orthogonal to the plane of the display.

[0006] In the system, the computer may be further programmed to: project a straight line on the display based on a user input, and determine the first horizontal axis based on an angle defined between the straight line and a predetermined horizontal axis.

[0007] In the system, the computer may be further programmed to determine a second horizontal axis of the plane of the display when angular movement of the display is detected.

[0008] In the system, the computer may be further programmed to, when additional angular movement of the display is detected after determining the second horizontal axis, determine a third horizontal axis based on the additional angular movement.

[0009] In the system, the computer may be further programmed to: determine a vertical axis perpendicular to the second horizontal axis.

[0010] The system wherein the computer may be further programmed to determine the vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display.

[0011] In the system, the computer may be further programmed to: upon receiving the second user input, map the second user input based on the second horizontal axis and the vertical axis.

[0012] In the system, the computer may be further programmed to: actuate a component in the second device based on the second user input.

[0013] A method comprising: determining a first horizontal axis of a plane of a display based on a user input; collecting angular motion data of the display; determining a second horizontal axis of the plane of the display based on the angular motion data; and mapping a second user input on the display based on the second horizontal axis.

[0014] The method may include determining a rotation angle based on the angular motion data, and determining a second horizontal axis based on the rotation angle.

[0015] The method may include determining the angle of rotation based on an angular velocity about an axis orthogonal to the plane of the display.

[0016] The method may include projecting a straight line on a display based on a user input, and determining the first horizontal axis based on an angle defined between the straight line and a predetermined horizontal axis.

[0017] The method may include determining a second horizontal axis of the plane of the display upon detecting angular movement of the display.

[0018] The method may include, upon detecting further angular movement of the display after determining the second horizontal axis, determining a third horizontal axis based on the further angular movement.

[0019] The method may include determining a vertical axis that is perpendicular to the second horizontal axis.

[0020] The method may include determining a vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display.

[0021] The method may include, upon receiving the second user input, mapping the second user input based on the second horizontal axis and the vertical axis.

[0022] The method may include actuating a component in the second device based on the second user input. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a block diagram of an exemplary wearable device.

[0024] Figure 2 Receiving user input to an exemplary wearable device to determine a first set of axes is shown.

[0025] Figure 3 Mapping of a first set of axes based on user input is shown.

[0026] Figure 4 Determining the rotation angle based on a first set of axes is shown.

[0027] Figure 5 Defining a second set of axes based on user input and rotation of the wearable device is shown.

[0028] Figure 6 An example process for determining an axis of a wearable device is shown. DETAILED DESCRIPTION

[0029] A system includes a computer programmed to: determine a first horizontal axis of the plane of a display based on a user input; collect angular motion data of the display; determine a second horizontal axis of the plane of the display based on the angular motion data; and map a second user input on the display based on the second horizontal axis.

[0030] The computer may be further programmed to determine the rotation angle based on the angular motion data and to determine the second horizontal axis based on the rotation angle.The computer may be further programmed to determine the rotation angle based on an angular velocity about an axis orthogonal to the plane of the display.

[0031] The computer may also be programmed to project a straight line on the display based on a user input, and determine the first horizontal axis based on an angle defined between the straight line and the predetermined horizontal axis.

[0032] The computer may also be programmed to: upon detecting angular movement of the display, determine a second horizontal axis of the plane of the display. The computer may also be programmed to: upon detecting additional angular movement of the display after determining the second horizontal axis, determine a third horizontal axis based on the additional angular movement.

[0033] The computer may also be programmed to determine a vertical axis perpendicular to the second horizontal axis. The computer may also be programmed to determine a vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display. The computer may also be programmed to map the second user input based on the second horizontal axis and the vertical axis upon receiving the second user input.

[0034] The computer may also be programmed to actuate a component in the second device based on the second user input.

[0035] A method includes determining a first horizontal axis of a plane of a display based on a user input; collecting angular motion data of the display; determining a second horizontal axis of the plane of the display based on the angular motion data; and mapping a second user input on the display based on the second horizontal axis.

[0036] The method may further include determining a rotation angle based on the angular motion data, and determining the second horizontal axis based on the rotation angle.The method may further include determining the rotation angle based on an angular velocity about an axis orthogonal to the plane of the display.

[0037] The method may further include projecting a straight line on the display based on a user input, and determining the first horizontal axis based on an angle defined between the straight line and a predetermined horizontal axis.

[0038] The method may further include determining a second horizontal axis of the plane of the display upon detecting angular movement of the display. The method may further include determining a third horizontal axis based on further angular movement upon detecting further angular movement of the display after determining the second horizontal axis.

[0039] The method may further include determining a vertical axis perpendicular to the second horizontal axis. The method may further include determining a vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display. The method may further include, upon receiving a second user input, mapping the second user input based on the second horizontal axis and the vertical axis.

[0040] The method may further include actuating a component in the second device based on the second user input.

[0041] A computing device is also disclosed, the computing device being programmed to perform any of the above method steps. A portable device comprising the computing device is also disclosed. A computer program product is also disclosed, comprising a computer-readable medium storing instructions executable by a computer processor to perform any of the above method steps.

[0042] The display of the wearable device can have a predetermined axis. Additionally, based on the user input, the processor of the wearable device can determine the user-defined axis. Upon receiving another input from the user, the processor can map the input from the predetermined axis to the user-defined axis. Additionally, when the wearable device rotates relative to one or more of the axes, the processor can determine a new axis based on the rotation speed and map the additional user input to the new axis. Thus, the user can provide input to the display of the wearable device without having to maintain the same orientation as the wearable device when providing the input. Additionally, the wearable device can actuate a device based on the user input, such as a virtual reality display, a portable device, etc.

[0043] Figure 1An exemplary wearable device 100 is shown. As used herein, a "wearable device" is a portable computing device that includes a structure that facilitates wearability on a human body (e.g., as a watch or bracelet, as a pendant, etc.), and includes a memory, a processor, a display, and one or more input mechanisms (such as a touch screen, buttons, etc.) and hardware and software for wireless communications such as those described herein. The wearable device 100 has a size and shape that is adapted to or worn on a human body (e.g., a watch-like structure including a bracelet band, etc.), and therefore will typically have a display that is smaller (e.g., 1 / 3 or 1 / 4 the area) than a user device (e.g., a smartphone, tablet, etc.). For example, the wearable device 100 can be a watch, a smart watch, a vibration device, etc., that includes a device for using IEEE 802.11, The wearable device 100 may use such communication capabilities to communicate with the wearable device 100 via a network (e.g., using ) for communication.

[0044] The wearable device 100 includes a wearable device processor 105 and a memory 106. The processor 105 is implemented via a circuit, chip, or other electronic component that can receive data from the sensor 110 and determine the orientation of the wearable device 100 based on the data. The processor 105 can be programmed to process the sensor 110 data. Processing the data can include processing acceleration or other data captured by the sensor 110 to determine the angular motion of the wearable device 100.

[0045] The memory 106 may be of any known type, such as a hard drive, a solid state drive, a server, or any volatile or non-volatile medium. The memory 106 may store the collected data sent from the sensor 110 .

[0046] The wearable device 100 includes one or more sensors 110. The sensors 110 may include various devices. For example, as is known, various controllers in the wearable device 100 may operate as sensors 110 to provide data via a wearable device 100 network or bus, for example, data related to the position, speed, rotation, acceleration, etc. of the wearable device 100. In addition, other sensors 110 may include cameras, motion detectors, biometric detectors, etc., i.e., the sensors 110 provide data to assess the location of an object, determine the presence of a user, etc. The sensors 110 may communicate with the processor 105.

[0047] Wearable device 100 includes display 120. Display 120 can receive user input (e.g., as a touch screen display). Display 120 can define a plane that processor 105 can use to map user input to instructions to actuate one or more wearable device 100 components. The user input can be a sliding motion on display 120.

[0048] The wearable device 100 can communicate with a network 125. The processor 105 can also be programmed to communicate with one or more remote sites (such as, for example, a virtual reality display, a portable device, etc.). The network 125 represents one or more mechanisms by which the vehicle computer can communicate with the device 130. Thus, the network 125 can be one or more of a variety of wired or wireless communication mechanisms, including any desired combination of wired (e.g., cable and fiber optic) and / or wireless (e.g., cellular, wireless, satellite, microwave, and radio frequency) communication mechanisms, and any desired network topology (or topology when multiple communication mechanisms are utilized). Exemplary communication networks include wireless communication networks that provide data communication services (e.g., using Low power consumption (BLE), IEEE 802.11, Local Area Network (LAN), and / or Wide Area Network (WAN), including the Internet).

[0049] The wearable device 100 can communicate with a second device 130. The device 130 may include a processor and a memory. The device 130 may be, for example, a virtual reality display, a portable device, etc. The wearable device 100 may instruct the processor of the device 130 to actuate one or more components, for example, a display, an alarm, etc.

[0050] Figure 2 The wearable device 100 is shown receiving a user input 200. The user input 200 may be a tactile input extending onto the display 120, the tactile input being measured by one or more sensors 110 in the wearable device 100. The processor 105 may prompt the user for the input 200. By providing the initial input, the processor 105 may determine an axis of the display 120 to map future user inputs. The processor 105 may prompt the user using, for example, a visual indicator on the display 120, an audio prompt, a tactile prompt, etc. The processor 105 may receive the input on the display 120, for example, as a sliding motion on the display 120, such as shown by an arrow representing the input 200.

[0051] Figure 3The processor 105 is shown mapping an input 200 on the display 120 to a horizontal axis X. The display 120 includes a center point O. The center point O is a fixed point on the display 120 that defines a horizontal axis and a vertical axis, as described below. The display 120 may have a predetermined display axis X extending through the center point O. 0 , Y 0 , Z, such as Figure 4 As shown. Display axis X 0 Is the horizontal axis. Display axis Y 0 Perpendicular to the horizontal axis X of the display 0 Axis Z passes through the center point (e.g., at the center of axis X). 0 , Y 0 The right-hand rule is used in the case of extending O perpendicular to the display 120. The display axis X 0 , Y 0 Defined in the plane of the display 120 , and the axis Z extends orthogonal to the plane of the display 120 .

[0052] The processor 105 may project a straight line extending through the received user input 200. The user input 200 may be received as a series of discrete points 300 on the display 120 indicating portions of the display 120 contacted by the user. The wearable device processor 105 may determine the line extending through the discrete points 300 using known regression techniques (e.g., least squares fitting). If the line does not extend through the center point O, the processor 105 may map the line defined by the user input 200 to a horizontal axis X passing through the center point O. The processor 105 may determine a line that is parallel to the input 200 and extends through the center point O, and define the line as the horizontal axis X.

[0053] The processor 105 may define a horizontal axis X based on the line extending through the user input. The horizontal axis X may be an axis extending parallel to the line through the center o. The wearable device processor 105 may define a vertical axis Y perpendicular to the horizontal axis X and extending through the center o.

[0054] Figure 4 The rotation angle θ defined by the horizontal axis X is shown. The display 120 may have a display horizontal axis X 0 and the display vertical axis Y 0 The horizontal axis X may be defined about the horizontal axis X of the display 0 The processor 105 can rotate the horizontal axis X with the horizontal axis X of the display 0 For example, the processor 105 may compare the pixels on the display 120 corresponding to the horizontal axis X, and then use known triangulation techniques to determine the angle of rotation θ between the horizontal axis X and the display horizontal axis X. 0The angle θ between the pixels.

[0055] The processor 105 may map the input on the display based on the rotation angle θ. When the user provides input to the display 120, the processor 105 may map the input from the rotation axis X, Y (e.g., as shown in Equation 1 below) to the display axis X 0 , Y 0 :

[0056]

[0057] When receiving input on the display 120, the processor 105 may record the input as a set of coordinates defined along the rotated axes X, Y. The processor 105 may map the input to the display axis X at the rotation angle θ according to Equation 1 above. 0 , Y 0 Thus, input to the display 120 may be processed according to the user defined axis X, Y. The processor 105 may instruct another device (not shown), such as a virtual reality display, a portable device, etc., based on the input mapped to the user defined axis X, Y.

[0058] Figure 5 The wearable device 100 is shown rotating about an axis Z. The processor 105 can collect data about the angular motion of the display about the axis Z. The angular velocity data ω in radians per second Z The angular velocity data ω may be collected by the sensor 110 (eg, a gyroscope, an accelerometer, etc.) within a predetermined time period T (eg, 500 milliseconds). The processor 105 may use known techniques to collect the angular velocity data ω based on the angular velocity data ω. Z Determine the rotation angle θ′ relative to the horizontal axis X. For example, the wearable device processor 105 may determine the rotation angle θ′ using a numerical integration technique within a time period T, namely:

[0059]

[0060] The processor 105 may determine the second horizontal axis X' and the second vertical axis Y' based on the rotation angle θ'. The axis Z is orthogonal to the display 120 and to the axes X', Y'. That is, the input received on the display 120 according to the axes X', Y' may be mapped to the device axis X according to the following formula: 0 , Y 0 :

[0061]

[0062] After detecting ω ZWhen θ′ is a non-zero value, the processor 105 can determine the second axis X′, Y′. That is, when the processor 105 detects angular movement of the wearable device 100, the processor 105 can determine the new axis X′, Y′ and map the user input from the axis X′, Y′. That is, the axis X′, Y′ can be updated when a change in θ′ is detected. The processor 105 can be programmed to update the axis X′, Y′ when the detected rotation angle θ′ changes by more than a predetermined threshold (e.g., 1 degree).

[0063] The processor 105 may be programmed to receive a second user input (not shown, as the second user input may be shown in a manner that shows input 200) to define a second horizontal axis X'. As described above, the user may provide tactile input on the display 120, and the processor 105 may map the user input to the second horizontal axis X' and the second vertical axis Y'. The processor 105 may determine to prompt the user for a second user input when, for example, the user requests a reset of the axes X', Y', the wearable device 100 has been powered off and restarted, etc.

[0064] Figure 6 An exemplary process 600 for operating the wearable device 100 is shown. The process 600 begins at block 605, where the processor 105 prompts the user to provide input 200 to the display 120 to define the first horizontal axis X. The processor 105 may provide a prompt (e.g., a visual prompt, an auditory tone, etc.) to instruct the user to provide the input 200 to the display 120.

[0065] Next, in block 610, the processor 105 receives the input 200 to the display 120. As described above, the user may provide an approximately straight line input 200 on the display 120. The display 120 may include one or more sensors 110 (e.g., capacitive sensors 110) that may detect the portion of the display 120 that is contacted by the user.

[0066] Next, in block 615, the processor 105 may determine a first horizontal axis X based on the input 200. The processor 105 may determine a line through the discrete points 300 of the input 200 using known techniques (e.g., a least squares calculation). The processor 105 may define an axis X that is parallel to the line and extends through the origin O. The processor 105 may further determine a first vertical axis Y as an axis perpendicular to the horizontal axis X.

[0067] Next, in block 620, the processor 105 may determine a rotation angle θ based on the first horizontal axis X. The processor 105 may align the first horizontal axis X with a predetermined device horizontal axis X. 0 Compare and define the horizontal axis X, X 0The processor 105 may then map the input to the display 120 to the axes X, Y based on the rotation angle θ as described above.

[0068] Next, in block 625, processor 105 determines whether one of sensors 110 detects rotation data ω Z As described above, as the wearable device 100 rotates about the axis Z, the sensor 110 (e.g., an accelerometer, a gyroscope, etc.) can detect the rotation of the wearable device 100 about the axis Z. If the processor 105 detects the rotation, the process 600 continues in block 630. Otherwise, the process 600 continues in block 640.

[0069] In block 630, processor 105 collects rotation data ω Z , and based on the rotation data ω Z The new rotation angle θ′ is determined. As described above, the processor 105 may use an integration technique (eg, numerical integration) based on the measured angular velocity ω determined from the accelerometer 110 Z A change in orientation of the wearable device 100 is determined.

[0070] Next, in block 635 , the processor 105 determines a second horizontal axis X′ and a second vertical axis Y′ based on the rotation angle θ′. As described above, the second horizontal axis X′ is an axis rotated from the horizontal axis X around the rotation angle θ′. The process 600 continues in block 655 .

[0071] In block 640, the processor 105 receives additional user input on the display 120. The user may provide input to the display 120 of the wearable device 100, for example, to actuate a component in a second device (virtual reality device, portable device, etc.). The additional user input may be subsequent to the user input defining the axes X, Y, and the processor 105 may be programmed to actuate the component in the second device according to the additional user input.

[0072] Next, in block 645, processor 105 maps additional user input to device axis X 0 , Y 0 As described above, based on the rotation angles θ, θ′, the processor 105 may map additional user input (eg, using equations 1, 3 shown above) to the device axis X 0 , Y 0 . Thus, a user can provide input to the display 120 of the wearable device 100 without having to maintain the same orientation as the wearable device 100 when providing the input.

[0073] Next, in block 650, the processor 105 actuates a component in the second device 130. The processor 105 may communicate with the second device 130 via the network 125 to actuate a component in the second device 130. For example, the processor 105 may actuate a virtual reality display to display one or more items. In another example, the processor 105 may actuate a processor in a portable device to operate a program.

[0074] In block 655, the processor 105 determines whether to continue process 600. For example, the processor 105 may determine to continue process 600 while the wearable device 100 is still communicating with the second device 130. If the processor 105 determines to continue, the process 600 returns to block 625 to determine whether the wearable device 100 has been rotated. Otherwise, the process 600 ends.

[0075] As used herein, the adverb "substantially" modifying an adjective means that the shape, structure, measurement, value, calculation, etc. may deviate from the precisely described geometry, distance, measurement, value, calculation, etc. due to imperfections in materials, processing, manufacturing, data collector measurements, calculations, processing time, communication time, etc.

[0076] The computer including the processor 105 and the memory 106 typically each includes instructions executable by one or more computers such as those identified above and for performing the blocks or steps of the above-described processes. The computer-executable instructions may be compiled or interpreted by a computer program created using a variety of programming languages ​​and / or techniques, including, alone or in combination, but not limited to Java. TM , C, C++, Visual Basic, Java Script, Perl, HTML, etc. In general, a processor (e.g., a microprocessor) receives instructions, for example, from a memory, a computer-readable medium, etc., and executes these instructions, thereby performing one or more processes, including one or more of the processes described herein. Such instructions and other data can be stored and transmitted using various computer-readable media. Files in a computer are typically collections of data stored on a computer-readable medium (such as a storage medium, a random access memory, etc.).

[0077] Computer-readable media include any media that participate in providing data (e.g., instructions) that can be read by a computer. Such media can take a variety of forms, including but not limited to non-volatile media, volatile media, etc. Non-volatile media include, for example, optical disks or disks and other permanent memories. Volatile media include dynamic random access memory (DRAM), which usually constitutes main memory. Common forms of computer-readable media include, for example, floppy disks, floppy disks, hard disks, tapes, any other magnetic media, CD-ROMs, DVDs, any other optical media, punch cards, paper tapes, any other physical media with hole patterns, RAMs, PROMs, EPROMs, flash EEPROMs, any other memory chips or cassettes, or any other medium that is computer-readable.

[0078] With respect to the media, processes, systems, methods, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced with the steps described being performed in an order other than the order described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. For example, in process 600, one or more steps may be omitted, or may be performed in an order other than the order described herein. Figure 6 The steps are performed in the order shown. In other words, the descriptions of systems and / or processes herein are provided for the purpose of illustrating certain embodiments and should in no way be construed as limiting the disclosed subject matter.

[0079] Therefore, it should be understood that the present disclosure including the above description and the accompanying drawings and the following claims is intended to be illustrative and not restrictive. After reading the above description, many embodiments and applications other than the examples provided will be apparent to those skilled in the art. The scope of the present invention should not be determined with reference to the above description, but should be determined with reference to the claims attached and / or based thereon included in the non-provisional patent application together with the full scope of equivalents to which such claims are entitled. It is conceivable and expected that future developments will occur in the technology discussed herein, and the disclosed systems and methods will be incorporated into such future embodiments. In summary, it should be understood that the disclosed subject matter is capable of modification and variation.

[0080] Unless otherwise specified or the context requires otherwise, the articles "a" and "an" modifying a noun are to be construed as meaning one or more. The phrase "based on" includes partially or completely based on.

Claims

1. A system for a wearable device, comprising a computer, wherein the computer is programmed to: determining a first horizontal axis of a plane of a display based on a user input, the first horizontal axis defining a first rotation angle about a display horizontal axis of the display and the user input being mapped from the first horizontal axis to the display horizontal axis; collecting angular motion data of the display; determining a second horizontal axis of the plane of the display based on the angular motion data, the second horizontal axis being an axis rotated from the first horizontal axis about a second rotation angle; as well as A second user input is mapped from the second horizontal axis to the display horizontal axis of the display.

2. The system of claim 1, wherein the computer is further programmed to determine the second rotation angle based on an angular velocity about an axis orthogonal to the plane of the display.

3. The system of claim 1, wherein the computer is further programmed to: project a straight line on the display based on the user input, and determine the first horizontal axis based on an angle defined between the straight line and a predetermined horizontal axis.

4. The system of claim 1, wherein the computer is further programmed to determine the second horizontal axis of the plane of the display upon detecting angular movement of the display.

5. The system of claim 4, wherein the computer is further programmed to, upon detecting additional angular movement of the display after determining the second horizontal axis, determine a third horizontal axis based on the additional angular movement.

6. The system of claim 1, wherein the computer is further programmed to: determine a vertical axis perpendicular to the second horizontal axis.

7. The system of claim 6, wherein the computer is further programmed to determine the vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display.

8. The system of claim 7, wherein the computer is further programmed to, upon receiving the second user input, map the second user input based on the second horizontal axis and the vertical axis.

9. The system of claim 1, wherein the computer is further programmed to: actuate a component in a second device based on the second user input.

10. A method for a wearable device, comprising: determining a first horizontal axis of a plane of a display based on a user input, the first horizontal axis defining a first rotation angle about a display horizontal axis of the display and the user input being mapped from the first horizontal axis to the display horizontal axis; collecting angular motion data of the display; determining a second horizontal axis of the plane of the display based on the angular motion data, the second horizontal axis being an axis rotated from the first horizontal axis about a second rotation angle; and A second user input is mapped from the second horizontal axis to the display horizontal axis of the display.

11. The method of claim 10, further comprising determining the second rotation angle based on an angular velocity about an axis orthogonal to the plane of the display. 12 . The method of claim 10 , further comprising projecting a straight line on the display based on the user input, and determining the first horizontal axis based on an angle defined between the straight line and a predetermined horizontal axis.

13. The method of claim 10, further comprising determining the second horizontal axis of the plane of the display when angular motion of the display is detected.

14. The method of claim 13, further comprising, upon detecting additional angular movement of the display after determining the second horizontal axis, determining a third horizontal axis based on the additional angular movement.

15. The method of claim 10, further comprising determining a vertical axis perpendicular to the second horizontal axis.

16. The method of claim 15, further comprising determining the vertical axis based on the second horizontal axis and an axis orthogonal to the plane of the display. 17 . The method of claim 16 , further comprising, upon receiving the second user input, mapping the second user input based on the second horizontal axis and the vertical axis.

18. The method of claim 10, further comprising actuating a component in a second device based on the second user input.

Images