Near field induction keyboard

Abstract

The invention relates to a keyboard control system and an operation method. The system includes at least two ultrasonic transducers disposed at a distance from each other in the keyboard, where at least one transducer is configured to transmit an ultrasonic signal and at least one transducer is configured to receive the ultrasonic signal and to provide a distance measurement of a reflective object relative to the transducers. The system is configured to calculate whether the object is within a predetermined range from the keyboard based on measurements from the two transducers, and if so, activate a predetermined function of the keyboard.

Description

[0001] The present invention relates to a keyboard capable of sensing user hand proximity and controlling the keyboard and associated keyboard functions.

[0002] Currently, computers and similar devices are increasingly advanced and also more complex, including many different units and processes for providing the user with the best and most convenient experience of using the device, such as lighting the keyboard for easier use in limited light. However, these processes and units require power and also increase the complexity and price of the device, as well as the possibility of failure. One well-known solution to reduce power consumption is the sleep mode, which is configured to be activated when the computer is inactive for a predetermined time. These modes usually require the user's action, such as moving the mouse or touching the keyboard, sometimes requiring the input of a password or touching a fingerprint sensor.

[0003] One example of a near field sensor related to a keyboard is described in US5758173, where an ultrasonic sensor is used to detect whether a user's hand is located above the keyboard. A more advanced solution for near field detection is presented in US2013275872A1, where an acoustic sensor such as a microphone is configured to sense the direction of a sound source, especially human voice, and activate the device when the user is in front of it. However, this requires a complex and thus power-consuming algorithm, and also a dedicated unit such as a microphone, since not every device is equipped with multiple microphones, nor with the required microphone quality. Another example of prior art is shown in WO2011 / 004135, where acoustic sensors in the device are used to measure movements and gestures, and it is also described to place the sensors in the keyboard of a laptop to support gesture measurements.

[0004] The present invention aims to provide a simple and cost-effective solution for activating power-consuming functions of a computer and / or associated keyboard. The specific implementation is as described in the attached claims.

[0005] The present invention thus provides a method of controlling the backlight of a keyboard by detecting whether a hand is located above the keyboard. The keyboard can be associated with a laptop or be a separate wired or wireless keyboard. When one or two hands are detected above the keyboard, the backlight is turned on, and when no hands are detected above the keyboard, the backlight is turned off, possibly after a predetermined time. In contrast to a separate wireless keyboard, the communication with the associated computer can be to turn on or off the backlight depending on the proximity of the hands.

[0006] The detected presence information can also be transmitted to a computer or external device in order to activate relevant functions in other devices in the communication network, as discussed in NO 20211334. In the same way, if the presence of the user is no longer detected, a signal indicating the absence of the user can be transmitted in the communication network and relevant functions can be turned off or reduced in order to save power.

[0007] According to another aspect of the invention, the near field detection system can be adapted to adjust predetermined properties of the acoustic signal based on the detected distance to the nearby object and / or movement of the nearby object, as disclosed in NO 20211332. This can include increasing the rate of the measured signal based on the distance, for example, increasing the rate when the object is closer to or moving towards the keyboard. The near field detection can be turned off or attenuated when the keyboard is in use.

[0008] In a preferred solution, the system initially employs a low power near field detection system, for example using known acoustic low power transmitter and receiver systems or transmitting at a low rate, to determine if a person is present. Once a user is detected, a second step is activated where the near field detection system increases activity and / or activates other sensors capable of detecting if a hand of the user is above the keyboard. If two independent sets of transducers are used, the first set of transducers can be deactivated as soon as a hand above the keyboard is detected. When other activity is detected, for example when the device is in use, the near field detection system can again be attenuated, possibly to a level where it is capable of detecting and measuring hand gestures above the keyboard or to a low level where it confirms the presence of a user.

[0009] According to another embodiment, the keyboard can comprise an analysis device configured to analyze the background signal and select frequency and sampling rate based on the signal from the environment, as discussed in NO 20220394.

[0010] The advantage is that in a dark room, the user does not need to find and press any key to light up the keyboard to start typing. It eliminates the predetermined timeout to turn off the backlight, creating a simple, smooth experience that fits the user's intention.

[0011] The same functionality can be used to switch full screen mode for specific applications that show / hide all or part of the UI. For example, video playback, word processor or reading mode in presentation software.

[0012] The invention can also provide more accurate hand movement measurements so that when the computer is locked, hand gestures on the keyboard can be used to turn on the facial recognition camera for login.

[0013] The simplest embodiment is to only recognize the gesture of the hand approaching the keyboard without detecting if the hand is stationary or if the hand is withdrawn from the keyboard.

[0014] The application will be described in more detail below by examples with reference to the accompanying drawings.

[0015] Figure 1 A computer with sensors according to the application is shown.

[0016] Figure 2 A measurement above the keyboard is shown.

[0017] Figure 3 A process performed by a system according to the application is shown.

[0018] Figure 1 A laptop computer 1 is shown, which has a main part 2 comprising a keyboard 3. The laptop also comprises a transducer unit 4, which in the figure consists of two emitters, such as loudspeakers 5, and one receiver, such as a microphone 6, located between the emitters. The laptop also has an additional sensor 8, which can be used as a near field sensor.

[0019] The loudspeakers or the microphone can consist of standard units, which allow the use outside the audible range, preferably in the ultrasonic range of 20-25 kHz. It is also possible to use a transducer, which is suitable for both emitting and receiving ultrasonic signals, in which case the microphone 6 can be omitted.

[0020] In the figure, the microphone 6 is located within or behind the keyboard, but it can also be located in any other position in connection with the keyboard, as long as it is able to receive reflections from objects above and near the keyboard. If there is an existing microphone suitable for receiving signals in the ultrasonic range, it can also be used.

[0021] Furthermore, in the case of a keyboard separate from the other parts of the computer, the activation signal can be transmitted to the computer or screen with the additional sensor 8 by wired or wireless communication with the keyboard, which starts the close near field detection sequence when the hand is within a predetermined distance from the keyboard.

[0022] In Figure 2In a specific embodiment, a measurement procedure is shown which is based on two loudspeakers 5 emitting a signal 10 which is reflected by the user's hand 9 towards a receiver 6 located in or near the keyboard. In this case, the proximity can be defined as the propagation time of the signal from the emitter to the receiver which is greater than the direct propagation from the emitter to the receiver and less than a predetermined limit which defines how close the hand should be to the keyboard. This predetermined height can be set by the user. Furthermore, the difference between the propagation times from each loudspeaker 5 to the receiver 6 must be less than a predetermined limit in order to ensure that the hand is located above the keyboard. This can be achieved using multiple transducers which are configured to measure the distance to the hand or person by analysing the distance between the reflecting object and each transducer. Additionally or alternatively, the signals can be time-stamped or coded, for example with different frequencies and / or amplitude profiles, so that the receiver is able to distinguish between them to measure the respective distances. In this way, the signals can also be emitted and received simultaneously. The distance measurement rate can be chosen depending on the device and the actual situation. If the transducers are configured to measure movements such as gestures on the keyboard, the measurement rate can be set higher than the measurement rate of the system which is set to simply confirm that the hand is still above the keyboard. The measurement sequence can be completely switched off as long as the keyboard and / or the computer are in use.

[0023] Other sensor configurations can also be considered, for example omitting the microphone 6 and using the first transducer 5 as both emitter and receiver, thus measuring both the distance from the transducer to the hand and indicating that the hand is above the keyboard when the measured distance difference is less than the size of the keyboard. Another option is to use one transducer as both emitter and receiver in the position of the microphone 6, where a central position can provide a good indication of whether the hand is above the keyboard if the measured distance is less than the size of the keyboard. Another possibility is to use one emitter and one receiver on each side of the keyboard, defining that the presence of a hand is indicated when the received signal propagation time is greater than the direct propagation of the signal through the keyboard and less than a predetermined limit corresponding to a certain distance of the hand from the keyboard.

[0024] Another possibility is to use multiple sensors at different positions on the keyboard in order to improve the ability to identify the position of one or more hands above the keyboard and possibly also to detect identifiable gestures above the keyboard. Thus, the functionality of being able to communicate with the keyboard or the associated computer without having to touch the keyboard is increased.

[0025] As mentioned above, the present application relates in particular to the activation of predetermined functions associated with the keyboard, in particular the backlighting of the keyboard. These functions can also include the measurement of movements of the hand above the keyboard, for example as discussed in WO2011 / 004135, which is incorporated herein by reference, which enables the detection and recognition of gestures made by the hand above the keyboard. This can also include additional sensors 8 Figure 1biometrics such as face recognition using a camera, voice recognition or a fingerprint sensor activated in a device connected to the keyboard or in the keyboard.

[0026] In a preferred embodiment, the activation can also be performed as a two-step process. First the proximity of a person, object, etc. is detected, for example using a first transducer group using a single signal emission and reception in order to provide proximity detection, then a second transducer group is activated to measure whether a hand is very close above the keyboard within a predetermined distance. In order to save power, if the first and second groups comprise different transducers, only the transducers active in the first transducer group can be deactivated or reduced in activity frequency as long as the second group confirms that a user activity related to the keyboard and / or computer indicates that it is in use.

[0027] Thus, in another alternative, the process can comprise a low-power initial detection for determining whether a user is present, then when proximity is detected, the activity frequency of the sensors, e.g. the position sampling rate and / or the number of sensors, is increased to detect whether a hand is above the keyboard, then when the computer or device is in an active use state, e.g. by the keyboard, mouse, touchpad, etc. The near-field detection can be suspended for a predetermined time period or sufficiently attenuated to maintain gesture detection capability or simple presence detection capability above the keyboard. Thus, when a user has approached and placed a hand above the keyboard but is not using the keyboard, the power consumption will be at a maximum. If the near-field sensors detect an activity enhancement, e.g. a distance change, without a corresponding keyboard activity, the activity of the transducers can be enhanced again. The detection or sampling rate can be adjusted stepwise or continuously based on the measured distance.

[0028] In more detail, as shown in Figure 3 The keyboard backlight or other functions can be turned off by the user or can be reactivated directly in a second step 12 after a certain time and within a selected time window without first entering the sleep mode 11, while the sleep mode can be entered after a longer time window or selected by the user.

[0029] The keyboard backlight or other functions can be turned off by the user or can be reactivated directly in a second step 12 after a certain time and within a selected time window without first entering the sleep mode 11, while the sleep mode can be entered after a longer time window or selected by the user.

[0030] In summary, the invention relates to a keyboard control system comprising at least one ultrasonic transducer configured to emit and receive ultrasonic signals, or possibly at least two ultrasonic transducers arranged at a distance from each other in the keyboard, wherein at least one transducer is configured to emit ultrasonic signals and at least one transducer is configured to receive ultrasonic signals, and to provide a measure of the distance of a reflecting object relative to the transducer based on the emitted and received signals. The system is configured to calculate based on the measurements from the two transducers whether an object is within a predetermined distance from the keyboard and to activate a predetermined function of the keyboard when an object, such as a hand or two hands, is close to the keyboard. This sequence can be done in two steps, first using a low power (e.g. at a slow repetition rate) signal to detect the proximity of an object or user, and then activating a close distance measurement to detect whether the object is within a predetermined distance after detecting the proximity.

[0031] Preferably, the function at least comprises providing a keyboard backlight. The backlight is activated when the presence of an object is detected and located within a distance from the keyboard.

[0032] When using at least two transducers, they can comprise two emitters for emitting identifiable ultrasonic signals and at least one receiver for receiving the reflected signals, or alternatively at least one emitter for emitting ultrasonic signals and at least two receivers for receiving the reflected signals. The system is thus configured to identify whether the propagation times of the reflected signals are within predetermined limits and whether the difference between the propagation times is within predetermined limits.

[0033] According to another embodiment, the at least two ultrasonic transducers comprise one emitter and one receiver located at opposite sides of the keyboard, the system being configured to identify the presence of the object based on the propagation times of the ultrasonic signals.

[0034] By analyzing the signals, the system is able to identify whether an object, typically a person or a hand, is close to the keyboard and in which direction. Thus, based on the analysis of the propagation times to and from the transducers, it can be detected whether the object is in front of the keyboard, which means that the user intends to use the keyboard, or to the side, which will not be interpreted as an intention to use the keyboard. The predetermined distance can thus depend on the position relative to the keyboard.

[0035] The transducers can also be configured to measure the movement of the object, thereby sensing whether the user intends to use the keyboard. This can involve detecting a user moving from a distance towards the keyboard or a user moving a hand closer to the keyboard. The system can also be configured to identify a set of predetermined movements on the keyboard, thereby being able to identify and interpret gestures performed by the user, for example for activating a selected function or giving a command to the associated computer.

[0036] The functionality can also include being configured to activate a biometric sensor, such as a facial recognition sensor, upon detecting the object approaching.

[0037] The use of the present application will therefore involve a method for controlling a keyboard and related devices, said keyboard comprising at least two ultrasonic transducers, wherein said method comprises the steps of:

[0038] a) emitting an ultrasonic signal from said at least one ultrasonic transducer and receiving a signal reflected from an object by said at least one ultrasonic transducer;

[0039] b) calculating whether said object is within a predetermined distance from the keyboard based on the propagation time of said signal;

[0040] c) activating a selected function of said keyboard and related devices if said object is within said predetermined range.

[0041] The method can comprise an initial step of emitting an ultrasonic signal from said at least one emitter and entering step a) upon receiving a reflected signal indicative of the presence of an object. In some cases, the method can be initiated by an inertial measurement in the received acoustic signal, touch sensitive device or keyboard or related device indicative of activity related thereto.

[0042] The method can also comprise the step of increasing the number of transducers used, increasing the measurement frequency and / or increasing the amplitude of the ultrasonic signal upon detecting that an object is in the vicinity. Furthermore, the number of transducers used, the measurement frequency and / or the amplitude of the ultrasonic signal can also be decreased when detecting that the keyboard or related devices are in use.

Claims

1. A keyboard control system comprising at least one ultrasonic transducer disposed in the keyboard, the at least one ultrasonic transducer being used to transmit and receive ultrasonic signals and to provide a measurement of the distance from the ultrasonic transducer to a reflective object, the system being configured to calculate, based on measurements from two of the ultrasonic transducers, whether the object is within a predetermined distance from the keyboard, and in such case activating a predetermined function of the keyboard.

2. The system according to claim 1, wherein the at least one ultrasonic transducer comprises at least one transmitter and at least one receiver.

3. The system according to claim 1, wherein the keyboard is provided with a keyboard backlight, the backlight being activated when an object is detected above the keyboard.

4. The system of claim 1, wherein the at least two ultrasonic transducers comprise two transmitters and at least one receiver, each transmitter transmitting an identifiable ultrasonic signal, the at least one receiver receiving a reflected signal, and the system being configured to identify whether the propagation time of the reflected signal is within a predetermined range, and whether the difference between the propagation times is within a predetermined range.

5. The system of claim 1, wherein the at least two ultrasonic transducers comprise at least one transmitter for emitting ultrasonic signals and at least two receivers for receiving the reflected signals, the system being configured to identify whether the propagation time of the reflected signals is within a predetermined range, and whether the difference between the propagation times is within a predetermined range.

6. The system of claim 1, wherein the at least two ultrasonic transducers include a transmitter and a receiver located on opposite sides of the keyboard, the system being configured to identify the presence of the object based on the propagation time of the ultrasonic signal.

7. The system of claim 1, wherein the ultrasonic transducer is configured to measure the movement of the object.

8. The system of claim 7, wherein the system is configured to recognize a predetermined set of movements on the keyboard, thereby enabling the recognition and interpretation of gestures performed by the user, such as for activating a selected function or issuing a command to the relevant computer.

9. The system of claim 1, wherein the system is configured to activate a biometric sensor, such as a facial recognition sensor, when the proximity of the object is detected.

10. The system of claim 1, configured to detect the presence of an object or person using a low-power signal in a first detection sequence, and to activate distance measurement when the presence is detected.

11. A method for controlling a keyboard and related devices, the keyboard including at least one ultrasonic transducer, wherein the method includes the following steps: a) Emitting an ultrasonic signal from the at least one ultrasonic transducer and receiving a signal reflected from an object through the at least one ultrasonic transducer; b) Based on the propagation time of the signal, calculate whether the object is within a predetermined distance from the keyboard; c) If the object is within the predetermined range, then activate the selected function of the keyboard and related devices.

12. The method of claim 11, comprising an initial step of transmitting an ultrasonic signal from the at least one transmitter, and in...

Images