Keyboard for touch-sensitive display device

Abstract

Examples are disclosed that relate to keyboards for touch-sensitive display devices. One example provides a touch-sensitive display device that includes a touch sensor, a display, a wireless receiver, a logic subsystem, and a storage subsystem. The storage subsystem includes instructions that are executable by the logic subsystem to detect, via the touch sensor, input applied to a keyboard in a first mode in which the keyboard satisfies detection conditions of the touch sensor, and receive, via the wireless receiver, input from the keyboard in a second mode in which the keyboard does not satisfy the detection conditions of the touch sensor, the input being at least partially detected by the keyboard operating in the second mode.

Description

Background Technology

[0001] Touch-sensitive input devices enable the reception of touch input, such as input applied by a finger or stylus. Some touch-sensitive input devices allow typing via touch input through a virtual keyboard display. Alternatively, a physical keyboard can be used to type input at a touch-sensitive input device. Attached Figure Description

[0002] Figure 1A-1B The corresponding arrangement between the example touch-sensitive display device and the example keyboard is shown.

[0003] Figure 2 schematically shown Figure 1A-1B Example implementation of a touch-sensitive display device and keyboard.

[0004] Figure 3 It shows Figure 1A-1B The back view of the keyboard.

[0005] Figures 4A-4C An example user interface is shown in Figure 1A-1B The display on the touch-sensitive display device.

[0006] Figure 5 It shows Figure 1A-1B Example depiction of touch-sensitive display devices and keyboards in mixed mode.

[0007] Figure 6 It shows Figure 1A-1B Another example depicting the operation of a touch-sensitive display device and keyboard in mixed mode.

[0008] Figure 7 A flowchart illustrating an example method for receiving keyboard input at a touch-sensitive display device is shown.

[0009] Figure 8 A block diagram of an example computing system is shown. Detailed Implementation

[0010] Touch-sensitive input devices enable the reception of touch input, such as input applied by a finger or stylus. Some touch-sensitive input devices allow typing via touch input through a virtual keyboard display. A virtual keyboard includes virtual keys, each selectable by applying touch input at a displayed location corresponding to that key. However, virtual keyboards present drawbacks that can negatively impact typing, such as incorrect key selection due to discrepancies between the expected and detected touch locations, lack of haptic feedback, and sluggish visual feedback in response to key presses. Thus, physical keyboards, including mechanically pressable keys, can be used for typing on touch-sensitive input devices. For example, a physical keyboard can be provided as a cover positioned on the touch-sensitive input device. Keys at the cover generate signals detectable by the touch sensors of the input device (e.g., by creating contact with the input device that can be detected as touch input (e.g., via capacitance measurement)). However, such a cover becomes ineffective when removed from the input device, thus limiting potential use cases.

[0011] Therefore, an example of a keyboard operable to provide input to a touch-sensitive display device both when covered by a display device and when separated from the display device is disclosed. When separated from the display device, keystrokes are detected by the keyboard and relayed to the display device via a wireless transmitter. When covered by the display device, keystrokes are detected by the touch sensor of the display device. The keyboard's wireless transmitter can be powered off when input is detected by the display device. Thus, the keyboard can be used in different arrangements relative to the display device, reducing power consumption and increasing battery life through selective activation of the wireless transmitter. Other examples provide a hybrid operating mode in which keystrokes at some keys are detected via the display device's touch sensor, while keystrokes at other keys are detected by the keyboard and transmitted to the display device via a wireless transmitter. Therefore, the hybrid mode provides robust keystroke detection (e.g., in cases where input detection at the keyboard or display device has degraded) and a mechanism to verify keystroke detection at the touch sensor.

[0012] Figure 1A-1B A keyboard 100 operable to provide input to a touch-sensitive display device 102 is shown. The keyboard 100 includes a plurality of keys 104, each selectable for providing a corresponding input to the display device 102. In the depicted example, the keyboard 100 is used to provide alphanumeric input to a word processing application running on the display device 102. However, the keyboard 100 can provide any suitable input to the display device 102, including but not limited to non-alphanumeric characters, input implementations of applications / operating systems running on the display device, and input implementations of the display device itself.

[0013] The keyboard 100 can be used in different orientations relative to the display device 102. Figure 1AIn this configuration, the keyboard 100 is positioned above and has sufficient physical proximity to the display device 102 to allow the touch sensors of the display device to detect input applied to the keyboard. Actuation of each key 104 can result in (e.g., on its underside) contact between a pressable pad coupled to that key and a touch surface 106 of the display device 102, wherein such contact can be detected as a touch input by the touch sensors (e.g., via capacitance measurement). Figure 2 One such implementation is described, in which actuation of key 104A causes a pressable pad 200 coupled to that key to contact touch surface 106. Touch sensor 202 of display device 102 detects this contact as a touch input (e.g., by recognizing a capacitance change caused by the presence of the pad). With knowledge of the orientation of keyboard 100 relative to display device 102 obtained as described below, the display device can then map the detected touch input location to the corresponding key and implement the functionality assigned to that key.

[0014] like Figure 1B As shown, the keyboard 100 is also available when positioned away from the display device 102. In this relative arrangement, the separation of the keyboard 100 from the display device 102 can cause the touch sensor 202 to fail to detect input applied to the keyboard. However, by detecting the input applied to the keyboard at the keyboard and transmitting the detected input from the keyboard to the display device, typing at the keyboard 100 can continue to be received at the display device 102. Figure 2 As shown, the keyboard 100 includes a wireless transmitter 204. Using this wireless transmitter 204, input detected at the keyboard is transmitted along a wireless communication link 208 to a wireless receiver 206 of the display device 102, thereby enabling keyboard operation remotely from the display device. The following references... Figure 2 The keyboard 100 is described as a component used to detect typed input.

[0015] The detection of keyboard input by touch sensor 202 occurs in operation referred to herein as the "first mode". In the first mode, keyboard 100 satisfies a detection condition of touch sensor 202. The detection condition can be defined such that input applied to keyboard 100 can be detected by touch sensor 202. In some examples, the detection condition can be defined based on the physical proximity between keyboard 100 and touch sensor 202. When a detection condition defined in this way is satisfied, the physical proximity between keyboard 100 and touch sensor 202 enables the touch sensor to detect keyboard input with a desired level of accuracy. In some examples, the detection condition may include contact between keyboard 100 and touch surface 106 (such as contact between pad 200 and touch surface 106 caused by pressing key 104A). In these examples, touch sensor 202 can identify the satisfaction of the detection condition by detecting touch input corresponding to the contact made by pad 200 and adopt the first mode in response. However, Figure 2 The keyboard is not drawn to scale, and the keyboard 100 can contact the touch surface 106 without any keys 104 being pressed—for example, the key pads 200 and / or the keyboard frame can contact the touch surface while the keyboard is overlaid on the display device 102.

[0016] The satisfaction of the detection conditions of the touch sensor 202 can be detected in any suitable manner. In the case where the touch sensor 202 is implemented as a capacitive touch sensor, the capacitive effect caused by the proximity of the touch sensor to the keyboard 100 can be detected. In a capacitive implementation, the touch sensor 202 may include multiple electrodes charged by a driving circuitry system, wherein those electrodes coupled to a receiving circuitry system (e.g., in a self-capacitance implementation) or a separate set of electrodes (e.g., in a mutual capacitance implementation) are configured to measure the capacitance and / or other electrical characteristics of the coupled electrodes. The receiving circuitry system can detect changes in electrode capacitance indicating proximity to the keyboard 100. Furthermore, changes in electrode capacitance can be located to determine the location of a touch input that can be mapped to a specific key 104, or, for other input devices (such as fingers or styluses) contacting the touch surface 106, to determine the location of such input devices. In some examples, the touch sensor 202 may employ a first scan setting to detect finger input and a second scan setting different from the first scan setting to detect keyboard input. Examples of modifiable scan settings include the drive signal for driving the electrodes, the associated sequence of signals received via the receiving circuitry system, the scan position, and the scan timing. While described in terms of capacitive implementation, the touch sensor 202 can implement other touch sensing technologies, such as resistive, acoustic, and optical touch sensing technologies. Furthermore, the touch sensor 202 can detect hover input in addition to touch input—that is, input applied by an input device adjacent to but not in contact with the touch surface 106. As used herein, “touch input” refers to both touch input and hover input.

[0017] The display device 102 may employ other mechanisms as a replacement or supplement to the touch sensor 202 to detect the fulfillment of detection conditions and / or other information about the input. Therefore, Figure 2 The illustration shows one or more sensors 210 included in the display device 102, which may include an ambient light sensor configured to detect the presence of the keyboard 100 by means of changes in ambient light caused by the keyboard obscuring the display device. For example, the ambient light sensor may be implemented in combination with an opening and a mask under the cover glass of the display device 102. As a further example, the sensors 210 may include an image sensor (e.g., as part of a camera) that detects the presence of the keyboard 100 via image data, and / or an infrared sensor that detects the presence of the keyboard via infrared data. Other sensors that detect electromagnetic effects from the presence of the keyboard may be used, including Hall effect sensors, magnetic sensors, and wireless charging coils.

[0018] As another example, sensor 210 may include a pressure sensor configured to detect the presence of keyboard 100 by pressure applied to display device 102 by the keyboard. However, touch sensor 202 may detect pressure capacitively, potentially in conjunction with a deformable layer, by variations in the distance between electrode layers. In yet another example, display device 102 may observe the presence of keyboard 100 by detecting wireless signals transmitted from wireless transmitter 204 of the keyboard via wireless receiver 206. The wireless signals may explicitly indicate the presence of keyboard 100, or they may implicitly indicate it—for example, display device 102 may detect that the amplitude or signal-to-noise ratio (SNR) of the signal is above a threshold, thereby implying the presence of keyboard.

[0019] In some implementations, as an alternative or addition to performing such detection at display device 102, keyboard 100 may detect the satisfaction of detection conditions of touch sensor 202. For example, keyboard 100 may detect wireless signals transmitted by wireless transmitter 214 of display device 102 via wireless receiver 212, and potentially detect that the amplitude or SNR of the signal is greater than a threshold. The wireless signal may be a carrier signal or any other suitable signal. As another example, keyboard 100 may detect signals transmitted by or used to drive touch sensor 202. In a capacitive implementation of touch sensor 202, keyboard 100 may include a receiving circuitry configured to detect, for example, capacitive signals used to drive the touch sensor. In yet another example, touch surface 106 of display device 102 may be coated with a conductive material, such that keyboard 100 can detect its proximity to the display device when the pad 200 of key 104 contacts the conductive material. The keyboard 100 can communicate the satisfaction of the detection conditions to the display device 102 via a wireless transmitter 204 or any other suitable mechanism.

[0020] In a first operating mode in which the keyboard 100 meets the detection conditions of the touch sensor 202, the display device 102 can detect the orientation of the keyboard relative to the touch sensor. Figure 3 An example mechanism by which the relative orientation of the keyboard 100 can be detected by the display device 102 is explained. (The last sentence appears to be incomplete and possibly contains errors. It's unclear what "from and" means.) Figure 1A and 1BThe depicted rear side of the key side shows an example of a keyboard 100, which includes four markers 300 fixed to the rear surface 302 of the keyboard. For example, the markers 300 may provide a pattern detectable capacitively and / or optically by the touch sensor 202 and / or / etc. sensors 210. Furthermore, the markers 300 can be distinguished from each other—in the depicted example, this is achieved by making marker 300A different from markers 300B, 300C, and 300D—for example, making marker 300A larger than markers 300B-300D, and / or having a different capacitive / optical pattern than markers 300B-300D. Using marker 300A, which is distinguishable from markers 300B-300D, the orientation of the keyboard relative to the touch sensor 202 can be accurately determined.

[0021] By leveraging the detectability of display device 102, marker 300 provides a mechanism for identifying the fulfillment of touch sensor detection conditions and a mechanism for determining the orientation of keyboard 100 relative to touch sensor 202. Therefore, the detection of the fulfillment of detection conditions and the determination of the orientation of keyboard 100 can be performed in a combined process using a shared mechanism to perform these two tasks. However, the relative orientation of keyboard 102 can be determined via any suitable technique, including based on outputs from sensors 210—e.g., from one or more of the Hall effect sensors, magnetic sensors, and wireless charging coils described above. Another method for determining the relative orientation may include transmitting the identity of a pressed key from keyboard 100 to display device 102; detecting a touch input corresponding to a key press at the display device; and mapping the key identity to the detected touch input location.

[0022] In some examples, detection of marker 300 can determine the orientation of the keyboard 100's boundary relative to touch sensor 202. In this case, display device 102 can combine the boundary orientation with predetermined knowledge of the layout of keys 104 in keyboard 100 to determine the orientation of each key relative to touch sensor 202, thereby enabling touch input to be accurately mapped to the corresponding key. As an example, this predetermined knowledge can be transmitted from keyboard 100 to display device 102 or can be stored on the display device. Other mechanisms for mapping touch input to corresponding keys 104 are possible—for example, each pad 200 can include a unique pattern that can be detected by touch sensor 202 and / or / etc. sensors 210, identifying the key to which the pad is coupled. Identifying key 104 via a corresponding unique pattern can reveal the identity of other keys when the relative positions of other keys to the identified key are known. The unique pattern can also provide input that is distinguishable from input created by fingers and / or styluses, thereby enabling, for example, accurate identification of an input device that provides touch input to display device 102. In some other examples, keyboard 100 may include a single mark 300, which, in combination with knowledge of the keyboard boundaries, determines the keyboard's orientation relative to touch sensor 202. For example, the rectangular boundaries of keyboard 100, along with the positions of the marks 300 arranged at the corners of the keyboard, can be determined to detect keyboard orientation.

[0023] In addition to informing how to map touch input to key 104, the orientation of keyboard 100 relative to touch sensor 202 can affect the output of the user interface on display 216 of display device 102. Figures 4A-4C Examples of display device 102 supporting variable positioning of keyboard 100 are explained, including positions where the keyboard occupies the bottom, middle, and top of touch surface 106. In each example, display device 102 detects the position of keyboard 100 and displays user interface 400 in a position not obscured by the keyboard. Figure 4A In this configuration, the keyboard 100 is positioned at the bottom of the touch surface 106, while the user interface 400 is correspondingly positioned at the top of the display 216. Figure 4B In this configuration, the keyboard 100 is positioned in the center of the touch surface 106, with the user interface 400 correspondingly positioned at the top and bottom of the display 216. Figure 4C In this configuration, the keyboard 100 is positioned on top of the touch surface 106, while the user interface 400 is correspondingly positioned at the bottom of the display 216.

[0024] Keyboard 100 can be arranged in conjunction with Figures 4A-4CThe keyboard 100 may be positioned and oriented differently from those described below. For example, the keyboard 100 may be rotated (e.g., approximately 90 degrees) and positioned on the left, right, or other portions of the touch surface 106. In other examples, the keyboard 100 may be positioned at an angle. In such examples, a subset of the keys 104 may be suspended above the touch surface 106, making it difficult for the touch sensor 202 to accurately detect input applied to these keys. In this case, the keyboard 100 and the touch sensor 202 may cooperate in an operation referred to as a “hybrid mode,” which is described in further detail below, to detect input across all keys 104.

[0025] In other examples, a physical mechanism may be provided at the keyboard 100 and / or the display device 102 to constrain or otherwise bias the keyboard relative to a specific position / orientation of the display device when the keyboard is placed on the display device and used in a first mode. In the case of a position / orientation of the keyboard 100 constrained in this manner, detecting the keyboard position / orientation at the display device 102 may include detecting the keyboard's positioning on the display device (e.g., without determining the position of capacitive / optical markers at the keyboard boundaries). As an example, the physical mechanism may include magnets disposed in the keyboard 100 and the display device 102, and / or one or more recesses in the display device frame that receive hooks or other protruding elements at the keyboard to releasably abut against the display device to constrain the keyboard.

[0026] Since the detection of keystrokes at keyboard 100 is served by touch sensor 202 in the first mode, components within the keyboard configured to detect keystrokes and wirelessly communicate with display device 102—thereby enabling keystrokes using a keyboard spaced apart from the display device—can be disabled in the first mode. For example, keyboard 100 may include a scanning circuitry system 219 coupled to keys 104 and configured to actively scan keys for presses. The scanning circuitry system 219, and therefore the scanning of keys 104 at keyboard 100, can be disabled in the first mode. With the scanning circuitry system 219 provided on a per-key basis, the scanning circuitry system may be disabled for some keys 104 but not others. However, any suitable mechanism (including a scanning circuitry system that passively detects keystrokes (e.g., where a key press causes the actuation of a switch, thereby generating a signal indicating a press)) can be used to detect keystrokes at keyboard 100. Furthermore, the wireless transmitter 204 and / or wireless receiver 212 of keyboard 100 can be disabled in the first mode. Disabling the components of the keyboard 100 in the first mode can reduce the consumption of charge stored in the battery 218 configured to power the keyboard 100, thereby extending the operating life of the keyboard for a given battery charge.

[0027] To enable and disable the various components of keyboard 100 and generally implement the keyboard operations as described herein, the keyboard includes a controller 220 configured to control the operation of a wireless transmitter 204, a wireless receiver 212, a battery 218, a scanning circuitry system 219, and other potential components. The controller 220 can enable and disable the keyboard components upon determining whether a detection condition of the touch sensor 202 is met. In other examples, the controller 202 can enable and disable the keyboard components in response to receiving a signal from the display device 102 via the wireless receiver 212 that results in enable / disable. In these examples, the wireless receiver 212 can remain enabled throughout the operation of keyboard 100 to facilitate the reception of such signals. On the other hand, the display device 102 includes a logic subsystem 222 and a storage subsystem 224, the storage subsystem 224 including instructions executable by the logic subsystem to implement the operation of the display device as described herein. For example, logic subsystem 222 can control touch sensor 202, wireless receiver 206, (various) sensors 210, wireless transmitter 214, and display 216. See below for reference. Figure 8 Example implementations of controller 220, logic subsystem 222, and storage subsystem 224 are described.

[0028] As described above and as Figure 1B As explained herein, keyboard 100 is operable to provide input when separated from display device 102 by detecting keystrokes on the keyboard and wirelessly transmitting the detected input to the display device, in operation referred to herein as "second mode". In second mode, keyboard 100 does not meet the detection conditions of touch sensor 202. For example, in cases where the detection conditions are defined based on the physical proximity between keyboard 100 and touch sensor 202 as described above, the detection conditions may not be met due to the lack of such physical proximity between the keyboard and touch sensor.

[0029] A second mode can be adopted in response to determining that the touch sensor detection condition is not met. Given the methods described above for determining that the detection condition is met, this determination can be performed at the keyboard 100 and / or the display device 102. Regarding the display device 102, it can detect that the detection condition is not met based on the absence / lack of capacitive, electromagnetic, optical, and / or pressure effects from the keyboard 100. For example, the display device 102 can detect the absence of one or more markers 300 in capacitance measurements captured by the touch sensor 202. Alternatively or additionally, the display device 102 can detect the absence of the keyboard 100 in ambient light data, image data, infrared data, and / or pressure data via outputs from the sensors 210. Furthermore, the display device 102 can detect the absence of the keyboard 100 by observing the absence of a wireless signal transmitted from the keyboard's wireless transmitter 204 at the wireless receiver 206. Alternatively, the display device 102 may detect a wireless signal emitted from the wireless transmitter 204 indicating that the keyboard 100 is separated from the display device—for example, the signal may explicitly indicate a lack of such proximity (e.g., in an implementation where the keyboard detection detection condition is met), or may exhibit noise exceeding a threshold that implicitly indicates a lack of proximity.

[0030] Regarding the determination that a detection condition is not met at keyboard 100, the keyboard may make such a determination in response to the observation at wireless receiver 212 of the absence of a sufficiently strong wireless signal transmitted from display device 102 via wireless transmitter 214. This signal can serve as an indicator of the physical proximity between keyboard 100 and display device 102; if the signal is insufficient, the keyboard-display physical proximity is insufficient to support operation in the first mode. However, the wireless signal can be at least partially orthogonal to the quality of wireless communication between keyboard 100 and display device 102 in the second mode. In other words, an insufficiently strong wireless signal can indicate insufficient physical proximity for operation in the first mode, which is sufficient to support operation in the second mode. Alternatively or additionally, if keyboard 100 includes a receiving circuitry system operable for detecting capacitive signals used to drive touch sensor 202, the keyboard may determine that the detection is not met in response to the observation via the receiving circuitry system of the absence of such capacitive drive signals or the presence of capacitive drive signals with noise exceeding a threshold.

[0031] In some of the implementations mentioned above, the display device 102 can disable the wireless transmitter 204 of the keyboard 100 in a first operating mode and enable it in a second mode. To do this, the display device 102 can transmit signals via the wireless transmitter 214, which, when received by the wireless receiver 212 of the keyboard 100, respectively cause the wireless transmitter 204 to be enabled and disabled. Disabling the wireless transmitter 204 in the first mode reduces the consumption of the charge stored in the battery 218 while continuing to enable the detection of keystrokes at the keyboard 100.

[0032] Regarding the battery 218's power status, keyboard 100 can output an indication of the power status. Return to Figure 1A The keyboard 100 may include a light-emitting diode (LED) 108 configured to indicate the state of charge of the battery 218—for example, the LED 108 may illuminate in response to the battery level falling below a threshold charge level. When the keyboard 100 is used away from the display device 102 in a second operating mode, illumination from the LED 108 may suggest to the user that the keyboard be positioned on the display device so that it can be used in the first operating mode. In some examples, the display device 102 may charge the battery 218 while the keyboard 100 is used in the first mode (e.g., via a wireless charging coil as described above). Furthermore, the display device 102 may—for example, via a graphical output shown on the display 216—output an indication of the state of charge of the battery 218, which may indicate that the charge level has fallen below a threshold and / or a charge level or percentage.

[0033] As mentioned above, a third operating mode is possible, in which the detection of keystrokes at keyboard 100 is distributed between the keyboard and display device 102. Figure 5An example of operation in this "hybrid mode" is described, wherein input applied to a first subset 500 (unshadowed) of keys 104 is detected via touch sensor 202, and a second subset 502 (shadowed) of keys is detected via keyboard 100 and transmitted to display device 102 via wireless transmitter 204. In this example, the first subset 500 satisfies the detection conditions of touch sensor 202, while the second subset 502 does not, even though keyboard 100 is physically placed on display device 102 adjacent to the touch sensor. The failure of the second subset 502 to meet the detection conditions can occur for various reasons. For example, the operation of touch sensor 202 may have degraded in the area occupied by the second subset 502—for example, due to aging or electromagnetic interference that temporarily interrupts touch sensor operation. As another example, the keys of the second subset 502 may not provide touch input that can be detected by touch sensor 202 (e.g., due to physical degradation of their pads 200 or corresponding actuation mechanisms), thus prompting them to be detected by keyboard 100.

[0034] Figure 5 The entire keyboard 100, occupying the touch surface 106, is depicted. However, the following scenario is possible: a subset of keys may fail to meet the touch sensor detection conditions due to the keyboard being positioned such that a subset of keys is not within sufficient physical proximity to the touch sensor 102 for the touch sensor to detect input applied to that subset of keys. Figure 6 This describes one such example where the keyboard 100 is positioned such that a first subset 600 (shadowed) of the keys 104 is suspended above the touch surface 106, thus failing to meet the touch sensor detection conditions. Therefore, input at the first subset 600 is detected by the keyboard 100 and transmitted to the display device 102. A second subset 602 (unshadowed) of the keys 104 remains on the touch surface 106 and meets the touch sensor detection conditions. Therefore, input at the second subset 602 is detected via the touch sensor 202. Other positions / orientations of the keyboard 100 could cause a subset of the keys 104 to fail to meet the touch sensor detection conditions—for example, the keyboard might be positioned at an angle tilted relative to the display device 102, causing a subset of the keys to be suspended above the touch surface 106.

[0035] To identify a scenario where a subset of keys 104 does not meet the touch sensor detection conditions while another subset of keys does, the display device 102 can determine the orientation of the keyboard 100 relative to the touch sensor 202 in the manner described above. No one or more markers 300 (where the presence of all markers is expected) can indicate that a subset of keys is suspended above the touch surface 106 and therefore cannot be detected by the touch sensor 202. Another method for identifying keys 104 that do not meet the touch sensor detection conditions includes: detecting a test input applied to a specific key at the keyboard 100; transmitting the test input to the display device 102 via a wireless transmitter 204; and subsequently determining at the display device 102 whether the test input applied to that key was also detected by the touch sensor 202. This verification mechanism can be performed for any number of keys 104, and in some examples for all keys, to identify keys whose input cannot be detected by the touch sensor 202.

[0036] This verification mechanism can also be used to determine whether the immediate mode in which the keyboard 100 / display device 102 is operating is functioning as expected, or to adopt a different operating mode. For example, the verification mechanism can be executed at periodic intervals or in response to any suitable trigger (such as a request to execute the mechanism, e.g., via user input or initiated by the keyboard 100 or display device 102) to ensure correct operation of the operating mode. Regarding changing the immediate operating mode, the verification mechanism can be used to stop operation in the second mode and (e.g., in response to detecting a successful keystroke at touch sensor 202) adopt the first mode, or to switch from the first mode to a mixed mode for key 104 if no input is detected at touch sensor 202. The verification mechanism can also be executed in the first mode to verify its correct operation and to switch from the first mode to the second mode if no keystroke is detected at touch sensor 202. The verification mechanism can also be used to continue operation in the second mode in response to detecting no keystroke at touch sensor 202.

[0037] In the hybrid mode, various features of the keyboard 100 can be disabled. For example, scanning of keys 104 detected by the touch sensor 202 instead of the keyboard 100 can be disabled (e.g., by disabling the scanning circuitry for those keys if a per-key scanning circuitry is provided). Alternatively or additionally, the transmission of wireless signals from the wireless transmitter 204 indicating input at those keys can be disabled. However, the transmission of wireless signals from the wireless transmitter 204 indicating input at other keys detected by the keyboard 100 can continue. Reducing, but not completely disabling, wireless transmissions from the keyboard 100 in this way can reduce bandwidth and power consumption at the keyboard. Furthermore, various features of the display 102 can be disabled in the hybrid mode. For example, the touch sensor 202 can disable scanning in the area corresponding to the input of keys 104 detected by the keyboard 100 instead of the touch sensor.

[0038] Figure 7 A flowchart illustrating a method 700 for receiving input applied to a keyboard at a touch-sensitive display device is shown. For example, method 700 may be implemented at display device 102 to receive input from keyboard 100.

[0039] At 702, method 700 may optionally include receiving test input from a keyboard via a wireless receiver of the display device. This test input may identify a key that, when pressed, causes the test input to be generated. At 704, method 700 may optionally include determining whether the test input has been detected via a touch sensor of the display device. If the test input is not detected by the touch sensor (no), method 700 proceeds to 718.

[0040] At 706, method 700 includes determining whether the entire keyboard satisfies detection conditions of the touch sensor. For example, the detection conditions can be defined based on the minimum physical proximity between the keyboard and the touch sensor, such that input applied to the keyboard can be detected by the touch sensor with desired accuracy. Determining whether the detection conditions are met may include: identifying the presence of one or more marks fixed to the keyboard at a display device; detecting capacitive, electromagnetic, optical, and / or pressure effects from the keyboard; and / or detecting wireless signals emitted by a wireless transmitter of the keyboard. Determining whether the detection conditions are met may include detecting wireless signals emitted by a wireless transmitter of the display device at the keyboard, and / or detecting capacitive effects from the touch sensor. If the entire keyboard does not satisfy the detection conditions (No), method 700 proceeds to 718. If the entire keyboard does satisfy the detection conditions (Yes), method 700 proceeds to 708.

[0041] At 708, method 700 includes employing a first operating mode where input applied to the keyboard is detected at a touch sensor rather than at the keyboard. Employing the first mode may include disabling the keyboard's wireless transmitter 710. The first mode may include detecting input applied to the keyboard via the touch sensor 712. The first mode may include detecting the keyboard's orientation relative to the touch sensor 714. The first mode may include outputting a user interface 716 via a display of a display device based on the keyboard's relative orientation.

[0042] At 718, method 700 includes determining whether at least a subset of the keyboard satisfies a detection condition. If the at least subset does indeed satisfy the detection condition (yes), then method 700 proceeds to 726. If the at least subset does not satisfy the detection condition (no), then method 700 proceeds to 720.

[0043] At 720, method 700 includes employing a second operating mode where input applied to the keyboard is detected at the keyboard. Employing the second mode may include enabling a wireless transmitter of the keyboard 722. The second mode may include receiving input applied to the keyboard, at least partially detected by the keyboard operating in the second mode, via a wireless receiver of the display device 724.

[0044] At 726, method 700 includes employing a third operating mode in which input applied to a first subset of the keyboard is detected via a touch sensor, while input applied to a second subset of the keyboard is detected by the keyboard and received at the touch sensor via a wireless receiver of the display device. In the third mode, the first subset of the keyboard meets a detection condition, while the second subset of the keyboard does not. Therefore, the second mode may include detecting input applied to the first subset via a touch sensor 728, and receiving input applied to the second subset via a wireless receiver of the display device 730. The second mode may include disabling scanning of the first subset by the keyboard 732.

[0045] Although shown as influencing the adoption of the first mode, receiving test input at 702 and determining whether test input has been received at 704—which could constitute at least part of the verification mechanism described above—may affect other actions (such as adopting / switching to the second and / or third mode) as an alternative to or supplement to influencing the adoption of the first mode. Furthermore, the verification mechanism may be performed during operation of one or more of the described operating modes to, for example, ensure correct operation in such modes. As another example, the verification mechanism may be performed in the third mode to determine whether key input was detected at the keyboard or via a touch sensor. As yet another example of how method 700 can be modified, the reception at 702 and the determination at 704 may alternatively be performed after the determination at 706.

[0046] The method described in this paper enables typing on a touch-sensitive display device via a keyboard that can be used in different positions and orientations relative to the display device. Operation in different modes allows typing detection to leverage the touch sensing capabilities of the display device, as well as the wireless communication capabilities of the keyboard and display device. Selectively disabling keyboard features can save power, reduce bandwidth consumption in wireless communication, and reduce potential interference. Furthermore, the keyboard—by virtue of its potential inclusion of physically pressable keys—can address the problems associated with typing on a virtual keyboard composed of virtual keys.

[0047] Various modifications to the disclosed methods are possible. For example, the touch sensor detection conditions can be defined based on other criteria (such as noise conditions associated with the wireless communication link between the keyboard and the touch sensor) that serve as a replacement or supplement to the physical proximity between the keyboard and the display device. In such examples, even if the keyboard is physically close enough to the touch sensor for the touch sensor to detect typing at the keyboard, the detection conditions may not be met if there is sufficient noise in the wireless communication link. However, in some examples, the detection conditions can be met even if the keyboard is not in contact with the touch surface where the touch sensor detects input. If the touch detection by the touch sensor is sufficiently free of noise / interference, keyboard input can be detected even if the keys do not contact the touch surface when pressed. In this case, key presses can produce hover input that can be detected by the touch sensor above the touch surface. Generally, the touch sensor detection conditions are met when the relative position / orientation between the keyboard and the touch sensor allows the keyboard input to be detected by the touch sensor with sufficient accuracy. Thus, this relative position / orientation can manifest as direct or indirect contact between the keyboard and the touch surface.

[0048] Furthermore, the hybrid operating mode can be implemented as part of a second operating mode, rather than being considered as distinct operating modes. In such examples, input applied to the keyboard can be detected at least partially by the keyboard (e.g., at keys where the detection condition is not met). Additionally, the keyboard and display device can achieve wireless communication according to any suitable protocol (including but not limited to Bluetooth).

[0049] In some embodiments, the methods and processes described herein may be associated with a computing system of one or more computing devices. Specifically, such methods and processes may be implemented as computer applications or services, application programming interfaces (APIs), libraries, and / or other computer program products.

[0050] Figure 8A non-limiting embodiment of a computing system 800 capable of performing one or more of the methods and processes described above is illustrated schematically. The computing system 800 is shown in a simplified form. The computing system 800 may take the form of one or more of the following: a personal computer, a server computer, a tablet computer, a home entertainment computer, a network computing device, a gaming device, a mobile computing device, a mobile communication device (e.g., a smartphone), and / or other computing devices.

[0051] The computing system 800 includes a logic subsystem 802 and a storage subsystem 804. The computing system 800 may optionally include a display subsystem 806, an input subsystem 808, a communication subsystem 810, and / or... Figure 8 Other components not shown.

[0052] The logic subsystem 802 includes one or more physical devices configured to execute instructions. For example, the logic subsystem may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform tasks, implement data types, transform the state of one or more components, achieve technical effects, or otherwise obtain desired results.

[0053] A logical subsystem may include one or more processors configured to execute software instructions. Additionally or alternatively, a logical subsystem may include one or more hardware or firmware logical subsystems configured to execute hardware or firmware instructions. The processor of the logical subsystem may be single-core or multi-core, and the instructions executed thereon may be configured for serial, parallel, and / or distributed processing. The individual components of the logical subsystem may optionally be distributed across two or more separate devices, which may be located remotely and / or configured for collaborative processing. Aspects of the logical subsystem may be virtualized and executed by remotely accessible, networked computing devices configured with cloud computing capabilities.

[0054] Storage subsystem 804 includes one or more physical devices configured to hold instructions executable by a logical subsystem to implement the methods and processes described herein. In implementing such methods and processes, the state of storage subsystem 804 can be transformed—for example, to hold different data.

[0055] Storage subsystem 804 may include removable and / or built-in devices. Storage subsystem 804 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-ray disc, etc.), semiconductor memory (e.g., RAM, EPROM, EEPROM, etc.) and / or magnetic memory (e.g., hard disk drive, floppy disk drive, magnetic tape drive, MRAM, etc.), etc. Storage subsystem 804 may include volatile, non-volatile, dynamic, static, read / write, read-only, random access, sequential access, location-addressable, file-addressable, and / or content-addressable devices.

[0056] It is understood that the storage subsystem 804 includes one or more physical devices. However, aspects of the instructions described herein may alternatively be propagated via a communication medium (e.g., electromagnetic signals, optical signals, etc.) that is not held by the physical device for a finite duration.

[0057] Various aspects of the logic subsystem 802 and the storage subsystem 804 can be integrated together into one or more hardware logic components. Such hardware logic components may include, for example, field-programmable gate arrays (FPGAs), application-specific integrated circuits (PASICs / ASICs), application-specific standard products (PSSPs / ASSPs), system-on-a-chip (SoCs), and complex programmable logic devices (CPLDs).

[0058] The terms "module," "program," and "engine" can be used to describe aspects of the computing system 800 implemented to perform specific functions. In some cases, a module, program, or engine can be instantiated by a logical subsystem 802 executing instructions held by a storage subsystem 804. It will be understood that different modules, programs, and / or engines can be instantiated from the same applications, services, code blocks, objects, libraries, routines, APIs, functions, etc. Similarly, the same modules, programs, and / or engines can be instantiated from different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms "module," "program," and "engine" are intended to encompass single or grouped executable files, data files, libraries, drivers, scripts, database records, etc.

[0059] As will be understood, a "service" as used herein can be an application that can execute across multiple user sessions. A service may be available to one or more system components, programs, and / or other services. In some implementations, a service may run on one or more server computing devices.

[0060] When included, display subsystem 806 can be used to present a visual representation of data held by storage subsystem 804. This visual representation may take the form of a graphical user interface (GUI). Since the methods and processes described herein change the data held by the storage subsystem, thereby transforming the state of the storage subsystem, the state of display subsystem 806 can also be transformed to visually represent changes in the underlying data. Display subsystem 806 may include one or more display devices utilizing substantially any type of technology. Such display devices may be combined with logic subsystem 802 and / or storage subsystem 804 in a shared package, or such display devices may be peripheral touch display devices.

[0061] When included, the input subsystem 808 may include or interface with one or more user input devices such as a keyboard, mouse, touchscreen, or game controller. In some embodiments, the input subsystem may include or interface with selected Natural User Input (NUI) components. Such components may be integrated or peripheral, and the translation and / or processing of input actions may be handled on-board or off-board. Example NUI components may include a microphone for speech and / or voice recognition; an infrared, color, stereo display, and / or depth camera for machine vision and / or gesture recognition; a head tracker, eye tracker, accelerometer, and / or gyroscope for motion detection and / or intent recognition; and an electric field sensing component for assessing brain activity.

[0062] When a communication subsystem 810 is included, the communication subsystem 800 may be configured to communicatively couple the computing system 1700 to one or more other computing devices. The communication subsystem 810 may include wired and / or wireless communication devices compatible with one or more different communication protocols. As a non-limiting example, the communication subsystem may be configured to communicate via a wireless telephone network, or a wired or wireless local area network or wide area network. In some embodiments, the communication subsystem may allow the computing system 800 to send messages to and / or receive messages from other devices via a network such as the Internet.

[0063] Another example provides a touch-sensitive display device including a touch sensor, a display, a wireless receiver, a logic subsystem, and a storage subsystem. The storage subsystem includes instructions executable by the logic subsystem to: detect input applied to the keyboard via the touch sensor in the first mode where the keyboard meets the detection conditions of the touch sensor; and receive input from the keyboard via the wireless receiver in the second mode where the keyboard does not meet the detection conditions of the touch sensor, the input being detected at least partially by the keyboard operating in the second mode. In such an example, the keyboard's wireless transmitter can be disabled in the first mode, and the wireless transmitter can be enabled in the second mode such that the wireless receiver of the touch-sensitive display device receives input from the wireless transmitter. In such an example, the instructions can be executed alternatively or additionally to disable the wireless transmitter in the first mode and enable it in the second mode. In such an example, the detection conditions may include contact between the keyboard and the touch surface of the touch-sensitive display device. In such examples, instructions may be executed alternatively or additionally to adopt a first mode in response to detecting that the keyboard meets the detection conditions of the touch sensor, and a second mode in response to detecting that the keyboard does not meet the detection conditions of the touch sensor. In such examples, instructions may be executed alternatively or additionally to adopt the first mode in response to detecting test input received from the keyboard via a wireless receiver via the touch sensor. In such examples, instructions may be executed alternatively or additionally to detect the orientation of the keyboard relative to the touch sensor in the first mode. In such examples, instructions may be executed alternatively or additionally to output a user interface at the display based on the orientation of the keyboard relative to the touch sensor. In such examples, instructions may be executed alternatively or additionally to detect input applied to the first subset of the keyboard via the touch sensor in a third mode where a first subset of the keyboard meets the detection conditions and a second subset of the keyboard does not meet the detection conditions; and to receive input applied to the second subset of the keyboard via the wireless receiver. In such examples, instructions may be executed alternatively or additionally to cause scanning of the first subset of the keyboard to be disabled in the third mode. In such examples, the touch sensor can use a first scanning setting to detect finger input and a second scanning setting, different from the first scanning setting, to detect input applied to the keyboard.

[0064] Another example provides a method at a touch-sensitive display device, comprising: detecting input applied to the keyboard via the touch sensor in the first mode where the keyboard satisfies a detection condition of the touch sensor of the touch-sensitive display device; and receiving input from the keyboard via a wireless receiver of the touch-sensitive display device in the second mode where the keyboard does not satisfy the detection condition of the touch sensor, the input being detected at least partially by the keyboard operating in the second mode. In such an example, in the first mode, the wireless transmitter of the keyboard may be disabled, while in the second mode, the wireless transmitter may be enabled such that input is received from the wireless transmitter via the wireless receiver of the touch-sensitive display device. In such an example, the detection condition may include contact between the keyboard and a touch surface of the touch-sensitive display device. In such an example, the method may alternatively or additionally include: adopting the first mode in response to detecting that the keyboard satisfies the detection condition of the touch sensor, and adopting the second mode in response to detecting that the keyboard does not satisfy the detection condition of the touch sensor. In such an example, the method may alternatively or additionally include: adopting the first mode in response to detecting a test input received from the keyboard via the wireless receiver via the touch sensor. In such an example, the method may alternatively or additionally include: detecting the orientation of the keyboard relative to the touch sensor in the first mode. In such examples, the method may alternatively or additionally include: detecting input applied to the first subset of the keyboard via a touch sensor in a third mode where a first subset of the keyboard satisfies the detection condition and a second subset of the keyboard does not; and receiving input applied to the second subset of the keyboard via a wireless receiver.

[0065] Another example provides a keyboard including a plurality of keys, a wireless transmitter, and a controller configured to disable the wireless transmitter in a first mode where the keyboard meets the detection conditions of a touch sensor, so that input applied to the keyboard is detected by the touch sensor; and to detect input applied to the keyboard and enable the wireless transmitter in a second mode where the keyboard does not meet the detection conditions, so that the detected input is transmitted to the touch sensor via the wireless transmitter. In such examples, the controller may alternatively or additionally be configured to detect and transmit input applied to a second subset of the plurality of keys via the wireless transmitter in a third mode where a first subset of the plurality of keys meets the detection conditions and a second subset of the plurality of keys does not meet the detection conditions, so that input applied to the first subset is detected by the touch sensor.

[0066] It should be understood that the configurations and / or methods described herein are exemplary in nature, and these specific embodiments or examples should not be considered limiting, as many variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. Thus, the various actions explained and / or described may be performed in the explained and / or described order, in a different order, in parallel, or omitted. Similarly, the order of the processes described above may be changed.

[0067] The subject matter of this disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems and configurations disclosed herein, as well as other features, functions, actions and / or attributes, and any and all equivalents thereof.

Claims

1. A system including a keyboard and a touch-sensitive display device, the touch-sensitive display device comprising: Touch sensor; monitor; Wireless receiver; Logical subsystem; as well as A storage subsystem, the storage subsystem including instructions executable by the logic subsystem to perform the following operations: Determine whether the keyboard meets the detection conditions of the touch sensor, wherein the detection conditions include contact between the keyboard and the touch surface of the touch-sensitive display device; A first mode is adopted in response to determining that the keyboard meets the detection condition of the touch sensor, and a second mode is adopted in response to determining that the keyboard does not meet the detection condition of the touch sensor; In a first mode where the keyboard meets the detection conditions of the touch sensor, input applied to the keyboard is detected via the touch sensor; as well as In a second mode where the keyboard does not meet the detection conditions of the touch sensor, input applied to the keyboard is received via the wireless receiver, the input being detected at least in part by the keyboard operating in the second mode; In the first mode, the wireless transmitter of the keyboard is disabled, while in the second mode, the wireless transmitter of the keyboard is enabled, so that the input is received from the wireless transmitter via the wireless receiver of the touch-sensitive display device.

2. The system of claim 1, wherein the instructions can be further executed to adopt the first mode in response to detecting test input received from the keyboard via the wireless receiver via the touch sensor.

3. The system of claim 1, wherein the instructions can be further executed to detect the orientation of the keyboard relative to the touch sensor in the first mode.

4. The system of claim 3, wherein the instructions can be further executed to output a user interface at the display based on the orientation of the keyboard relative to the touch sensor.

5. The system of claim 1, wherein the instructions can be further executed to detect input applied to the first subset of the keyboard via the touch sensor and receive input applied to the second subset of the keyboard via the wireless receiver in a third mode in which a first subset of the keys of the keyboard satisfies the detection condition and a second subset of the keys of the keyboard does not satisfy the detection condition.

6. The system of claim 5, wherein the instructions can be further executed to cause the keyboard to disable scanning of the first subset in the third mode.

7. The system of claim 1, wherein the touch sensor uses a first scanning setting to detect finger input and uses a second scanning setting different from the first scanning setting to detect the input applied to the keyboard.

8. A method for operating a touch-sensitive display device and a keyboard, comprising: Determine whether the keyboard meets the detection conditions of the touch sensor of the touch-sensitive display device, wherein the detection conditions include the contact between the keyboard and the touch surface of the touch-sensitive display device; A first mode is adopted in response to determining that the keyboard meets the detection condition of the touch sensor, and a second mode is adopted in response to determining that the keyboard does not meet the detection condition of the touch sensor; In a first mode where the keyboard satisfies the detection conditions of the touch sensor of the touch-sensitive display device, input applied to the keyboard is detected via the touch sensor; as well as In a second mode in which the keyboard does not meet the detection conditions of the touch sensor, input applied to the keyboard is received via a wireless receiver of the touch-sensitive display device, the input being detected at least in part by the keyboard operating in the second mode; In the first mode, the wireless transmitter of the keyboard is disabled, while in the second mode, the wireless transmitter of the keyboard is enabled, so that the input is received from the wireless transmitter via the wireless receiver of the touch-sensitive display device.

9. The method of claim 8, further comprising: The first mode is adopted in response to the detection of test input received from the keyboard via the wireless receiver via the touch sensor.

10. The method of claim 8, further comprising: In the first mode, the orientation of the keyboard relative to the touch sensor is detected.

11. The method of claim 8, further comprising: In a third mode where a first subset of the keyboard satisfies the detection condition while a second subset of the keyboard does not, input to the first subset of keys applied to the keyboard is detected via the touch sensor; And receive input from a second subset of the keys applied to the keyboard via the wireless receiver.

Images