Information input method, device and electronic equipment
By using millimeter wave frequency modulation continuous wave radar technology in electronic devices, the signal is transmitted and received to determine the input position of the operating body, the information input accuracy problem under the influence of the lighting environment is solved, and high accuracy and convenient air-to-air input is achieved .
Patent Information
- Application Number
- CN202110034918.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-12
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-01-12
AI Technical Summary
In the prior art, the accuracy of space input is affected by the strength of the lighting environment, resulting in poor accuracy of information input.
By transmitting signals to the preset operating area at every preset time, receiving the reflected signals from the operating body, determining the input position of the operating body and the corresponding target information based on the signal difference, and using millimeter wave frequency modulation continuous wave radar to realize the space button or The input of the keyboard establishes the mapping relationship between input location and information.
Improves the accuracy of information input, adapts to various environments, is not affected by light, has stronger compatibility and ease of use, and does not require external projection equipment.
Smart Images

Figure CN112684916B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of communication technology, and specifically relates to an information input method, device and electronic equipment. Background Art
[0002] With the development of communication and software technology, the role of electronic devices is becoming increasingly powerful. Electronic devices have evolved from simply meeting people's basic communication needs to being adjusted according to people's personal needs and becoming more personalized.
[0003] With the penetration of electronic devices into people's lives, the demand for remote input on electronic devices has begun to emerge because traditional keyboard input devices are inconvenient to carry. For example, corporate employees edit office documents while on business trips such as high-speed trains or airplanes.
[0004] At present, the main method of remote input is through an optical projection keyboard, which is affected by the intensity of the lighting environment and the accuracy of information input is relatively poor. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an information input method, device and electronic device, which can solve the problem in the prior art that the accuracy of remote information input is relatively poor due to the influence of the intensity of the lighting environment.
[0006] In a first aspect, an embodiment of the present application provides an information input method, which is applied to an electronic device, comprising:
[0007] transmitting a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device;
[0008] Receiving a second signal after the first signal is reflected by an operating body in the preset operating area;
[0009] Determining a first input position of the operating body performing a first input operation based on the first signal and the second signal;
[0010] Based on the first input position and a preset mapping relationship, first target input information corresponding to the first input operation is determined, and the preset mapping relationship is a correspondence relationship between an input position and input information.
[0011] In a second aspect, an embodiment of the present application provides an information input device, which is applied to an electronic device, including:
[0012] A transmitting module, configured to transmit a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device;
[0013] A receiving module, configured to receive a second signal after the first signal is reflected by an operating body in the preset operating area;
[0014] A first determining module, configured to determine a first input position of the operating body performing a first input operation based on the first signal and the second signal;
[0015] The second determination module is used to determine the first target input information corresponding to the first input operation based on the first input position and a preset mapping relationship, where the preset mapping relationship is a correspondence between an input position and input information.
[0016] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.
[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0019] In the embodiment of the present application, a first signal is transmitted to a preset operation area through an antenna at preset time intervals, and the preset operation area is a space area outside the electronic device; a second signal is received after the first signal is reflected by an operating body in the preset operation area; based on the first signal and the second signal, a first input position of the operating body performing a first input operation is determined; based on the first input position and a preset mapping relationship, the first target input information corresponding to the first input operation is determined, and the preset mapping relationship is a correspondence between the input position and the input information. In this way, remote input can be realized, and it is not affected by the strength of the lighting environment, so the accuracy of information input can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0021] Figure 1is a flow chart of the information input method provided by an embodiment of the present application;
[0022] Figure 2 This is a schematic diagram of a single air-key input based on millimeter-wave frequency-modulated continuous wave radar;
[0023] Figure 3 This is a schematic diagram of the input of the air keyboard based on the millimeter-wave frequency-modulated continuous wave radar array;
[0024] Figure 4 is a schematic diagram for judging a first input operation;
[0025] Figure 5 It is a schematic diagram of the process of establishing the mapping relationship between finger movement habits and keyboard characters;
[0026] Figure 6 is a schematic diagram of the structure of the information input device provided in an embodiment of the present application;
[0027] Figure 7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0028] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present application. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. In addition, the "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.
[0031] The information input provided by the embodiments of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0032] See also Figure 1 , Figure 1 is a flow chart of an information input method provided in an embodiment of the present application, which is applied to electronic devices such as Figure 1As shown, the following steps are included:
[0033] Step 101: Transmit a first signal to a preset operation area via an antenna at preset time intervals, where the preset operation area is a space area outside the electronic device.
[0034] In this embodiment, the electronic device may include multiple antennas, which may include a transmitting antenna and a receiving antenna, wherein the transmitting antenna and the receiving antenna may both be millimeter wave radar antennas, the transmitting antenna is used to transmit radar into space, and the receiving antenna is used to receive the radar signal transmitted by the transmitting antenna and reflected by an object.
[0035] The purpose of the embodiment of the present application is to transmit radar through a transmitting antenna, and to receive the signal transmitted by the radar through an operating body through a receiving antenna, and to locate the position and operation of the operating body through the transmitted signal and the reflected signal, thereby realizing the input of the operating body's remote buttons.
[0036] At least one radar chip can be installed in an electronic device to realize the function of an air keyboard, wherein the radar chip can have an antenna structure of at least one transmitting antenna and at least one receiving antenna, that is, one radar chip can realize the function of at least one air key.
[0037] The number of radar chips installed in electronic devices can be set according to the complexity of the air keyboard function implemented by the electronic device. If the air keyboard function is relatively complex, for example, the air keyboard includes not only 26 letter keys and 10 number keys, but also other command keys, such as the "shift" key. In this application scenario, more radar chips may need to be installed on the electronic device. If the air keyboard function is relatively simple, in this application scenario, a small number of radar chips can be installed on the electronic device to meet the needs.
[0038] In an optional implementation, the input of a single air-key can be implemented based on a millimeter-wave frequency-modulated continuous wave radar, which is described in detail below.
[0039] See also Figure 2 , Figure 2 This is a schematic diagram of a single air-key input based on millimeter-wave frequency-modulated continuous wave radar, such as Figure 2 As shown, the electronic device can be installed with a radar chip 201, which is an antenna structure of one transmitting antenna and two receiving antennas. In order to achieve more convenient input, the electronic device can also be installed with a bracket 202 to fix the electronic device.
[0040] The electronic device may transmit a first signal to a preset operation area through a transmitting antenna at preset time intervals, such as Figure 2As shown in the radar beam 203, the first signal may be a frequency modulated continuous wave radar, and the waveform may be a sawtooth wave, which is expressed as shown in the following formula (1):
[0041]
[0042] Among them, A T It can represent the amplitude of the transmitted signal, f is the carrier center frequency, f T (τ) is the frequency of the transmitted signal. The frequency of the transmitted signal can be expressed as shown in the following formula (2):
[0043] f T (τ)=τB / T (2)
[0044] Where B is the signal bandwidth and T is the frequency sweep period of the FM signal.
[0045] The preset operation area may be a space area within a preset range in front of the electronic device screen, and the electronic device may control the transmitting antenna to transmit the first signal to the space area within the preset range in front of the electronic device screen. The transmitting position may correspond to a coordinate in a first direction, such as the x direction, and the transmitting position may be different according to the different installation positions of the radar chip 201.
[0046] Step 102: Receive a second signal after the first signal is reflected by an operating body in the preset operating area.
[0047] In this step, the operating body refers to an object for performing air input, which may be a finger, a stylus, or other objects, which are not specifically limited here. In the following embodiments, the operating body will be described by taking a finger as an example.
[0048] A signal reflected by the first signal from an object in the preset operation area may be received, and the reflected signal may be expressed as shown in the following formula (3):
[0049]
[0050] Among them, A R It can represent the amplitude of the reflected signal, Δt is the time delay between the reflected signal and the transmitted signal, and f R (τ) is the frequency of the reflected signal. The frequency of the reflected signal can be expressed as shown in the following formula (4):
[0051] f R (τ)=(τ-Δt)B / T+Δf d (4)
[0052] Where Δf d is the Doppler shift.
[0053] Since the reflection amplitude of the electromagnetic wave signal when it encounters the finger is different from the reflection amplitude when it encounters other objects (such as a table), that is, A R Therefore, by judging the reflection amplitude of the received signal, it can be determined that the finger is located in the preset operation area. Correspondingly, a second signal is received after the first signal is transmitted by the finger in the preset operation area.
[0054] Step 103: Determine a first input position of the operating body performing a first input operation based on the first signal and the second signal.
[0055] In order to realize the input of air key, two judgments need to be realized, namely the position of the operating body, that is, the position judgment of the operating body in the preset operation area, and the judgment of the operating body performing the input operation, that is, the judgment of the finger tapping key action.
[0056] To realize air key input, the finger position must be located first. Figure 2 As shown, the radar chip radiates electromagnetic waves, i.e., the first signal, into space, and the emission position corresponds to different x-coordinates. The reflection amplitude of the electromagnetic wave signal when encountering the finger is different from the reflection amplitude when encountering other objects (such as a table). By judging its reflection amplitude, it can be determined that the finger is in the preset operation area, and accordingly, the coordinate information of the finger in the x-direction is obtained.
[0057] The second signal reflected by the finger is received by the radar antenna. From formula (1) and formula (3), it can be seen that there is a time delay Δt between the received and transmitted signals. The distance between the radar antenna and the finger can be determined based on the time delay. The distance represents the coordinate information of the finger in the second direction, such as the y direction, and can be expressed as shown in the following formula (5):
[0058] l=cΔt / 2 (5)
[0059] Where l is the distance between the radar antenna and the finger, and c is the speed of light in a vacuum.
[0060] It should be noted that, since it is difficult to measure Δt in actual situations, after the radar antenna receives the reflected signal, it will down-convert the transmitted signal to an intermediate frequency signal. In this way, according to the slope of the radar sawtooth wave B / T=f IF / Δt, which can be obtained by the intermediate frequency f IF to obtain Δt.
[0061] By determining the position coordinates (x1, y1) of the finger, the spatial correspondence between the finger and the air key can be obtained, such as Figure 2 As shown. Among them, Figure 2 The middle button area is only used to mark the button position. In actual application, this area does not display the button outline.
[0062] In addition, the realization of air key input also requires judging the movement of the finger to determine whether the finger is performing an input operation. Since the reflected signal of at least one position of the finger received by the radar antenna will change during the movement of the finger, it is possible to determine whether the finger has made a tapping action, that is, whether the input operation has been performed, by judging the reflected signal of at least one position of the finger.
[0063] In the case of determining that the operating body performs the first input operation, the first input position of the operating body performing the first input operation can be determined based on the first signal and the second signal. Specifically, the coordinate information x2 of the first input position in the x direction can be determined based on the transmission position of the first signal, and the coordinate information y2 of the first input position in the y direction can be determined based on the time interval between the transmission time of the first signal and the reception time of the second signal. The first input position is composed of the coordinate information in the x direction and the coordinate information in the y direction, which can be expressed as (x2, y2).
[0064] Step 104: Determine first target input information corresponding to the first input operation based on the first input position and a preset mapping relationship, where the preset mapping relationship is a correspondence between an input position and input information.
[0065] In this step, the preset mapping relationship may be a corresponding relationship between an input position and input information, and the input position may be a fixed input position or a relative input position relative to an initial position.
[0066] For example, when performing air input, a relatively fixed spatial area that is a fixed distance away from the electronic device and directly facing the screen of the electronic device can be determined as the air input area. The input position of this area is relatively fixed, and the user can input information only by performing input operations at the input position of the air input area. Correspondingly, the input position in the preset mapping relationship is a fixed input position.
[0067] For another example, when performing air input, the initial position of information input can be determined first, and the initial position can be defaulted to a line starting with the keyboard characters "ASDF", and then information input can be performed based on the initial position. Correspondingly, the input position in the preset mapping relationship is a relative input position relative to the initial position.
[0068] When the preset mapping relationship is a correspondence relationship between a fixed input position and input information, the input information corresponding to the first input position can be directly obtained from the preset mapping relationship, and the input information is the first target input information corresponding to the first input operation.
[0069] When the preset mapping relationship is a correspondence between the relative input position relative to the initial position and the input information, the initial position of the air input can be obtained, the relative input position of the first input position and the initial position can be determined, and the input information corresponding to the relative input position can be obtained from the preset mapping relationship. The input information is the first target input information corresponding to the first input operation.
[0070] Of course, in order to reduce the conversion of relative input positions for each input operation, after obtaining the initial position of the air input, the input position in the preset mapping relationship can be adjusted based on the initial position to adjust the input position in the preset mapping relationship to a fixed input position for this air input. For example, if the initial position is (10, 20), the input information corresponding to the initial position is the character "A", and the relative input position (1, 1) relative to the initial position in the preset mapping relationship corresponds to the input information of the character "Z". Based on the initial position, the relative input position in the preset mapping relationship can be adjusted to a fixed input position. After the adjustment, the input position (11, 21) in the preset mapping relationship can correspond to the input information of the character "Z". Afterwards, the input information corresponding to the first input position can be obtained from the adjusted preset mapping relationship, and the input information is the first target input information corresponding to the first input operation.
[0071] In this embodiment, a single air-key input can be realized based on the millimeter-wave frequency-modulated continuous wave radar. Compared with the optical projection keyboard, it is not affected by the lighting environment and can improve the accuracy of information input. In addition, it does not require an external projection device, can better adapt to various environments, and does not require additional learning costs, and has stronger compatibility and ease of use.
[0072] In another optional implementation, air keyboard input may be implemented based on a millimeter-wave frequency-modulated continuous wave radar array, which is described in detail below.
[0073] See also Figure 3 , Figure 3 This is a schematic diagram of the input of the air keyboard based on the millimeter wave frequency modulation continuous wave radar array, such as Figure 3 As shown, the electronic device can be equipped with multiple radar chips 301, and these multiple radar chips can form a radar array. The following takes a 1×5 radar chip single-row array as an example to illustrate the input of the air keyboard. The radar chip 301 can be an antenna structure of 2 transmitting antennas and 4 receiving antennas, and can eventually form an antenna array structure of 10 transmitting antennas and 20 receiving antennas.
[0074] The electronic device may transmit a first signal to a preset operation area through a transmitting antenna at preset time intervals, such as Figure 3As shown in the radar beam 302, the sweeping time of a common radar chip is in the order of ten milliseconds, and the average typing speed of a person is about one Chinese character per second. Therefore, the sweeping frequency of the radar chip can meet the typing needs of most people.
[0075] In order to realize the input of the air keyboard, two judgments need to be made, namely the position of the finger, that is, the spatial correspondence between the finger and the keyboard characters, and the judgment of the finger performing the input operation, that is, which keyboard character the finger taps.
[0076] To realize air keyboard input, the finger position must be located first. Figure 3 As shown in the figure, the 10 transmitting positions of the radar array radiate electromagnetic waves into space, and the 10 transmitting positions correspond to different x-coordinates. The reflection amplitude of the electromagnetic wave signal when encountering the finger is different from the reflection amplitude when encountering other objects (such as a table). By judging its reflection amplitude, the coordinate information of the finger in the x-direction can be obtained.
[0077] The signal reflected by the finger is received by the radar antenna. From formula (3), it can be seen that there is a time delay Δt between the received and transmitted signals, and the distance between the radar antenna and the finger can be obtained by formula (5), which is the coordinate information of the finger in the y direction.
[0078] The initial value of the radar antenna to obtain the finger's y-direction coordinate defaults to the line starting with the keyboard characters "ASDF" (i.e. Figure 3 The third row of the keyboard shown in the figure). Generally, the main input area of a keyboard has only four rows in the y direction, so for the finger position in the y direction, only four gears need to be judged to meet the requirements. These four gears can be called near gear, middle gear, middle-far gear and far gear respectively. The gears in the third row of the keyboard can be called middle-far gear, while the gears in the first row of the keyboard can be called near gear, the gears in the second row of the keyboard can be called middle gear, and the gears in the fourth row of the keyboard can be called far gear.
[0079] During the movement of the finger, if the coordinate value of the y direction of the detected finger position becomes smaller relative to the initial position, the finger may be located in the near range or the middle range. Then, the actual position of the finger is determined based on the coordinate value of the y direction. For example, if the initial value of the y direction is 20, and the current coordinate value of the y direction of the finger is 19, the finger is located in the middle range. If the current coordinate value of the y direction of the finger is 18, the finger is located in the near range. If the coordinate value of the y direction of the detected finger position becomes larger relative to the initial position, the finger is located in the far range.
[0080] By determining the position coordinates (x, y) of each finger, the spatial correspondence between the finger and the keyboard input character can be obtained, such as Figure 3 As shown, Figure 3 The middle keyboard area is only used to mark the character positions. In actual application, this area does not display the keyboard outline.
[0081] When performing air input, the specific characters input by the user can be determined by combining the finger position and the reflected signal of at least one position of each finger to determine whether the finger has performed the first input operation and the coordinate position of the first input operation.
[0082] In this embodiment, the input of the air keyboard can be realized based on the millimeter-wave frequency-modulated continuous wave radar array. Compared with the optical projection keyboard, it is not affected by the lighting environment and can improve the accuracy of information input. In addition, no external projection equipment is required, it can adapt to various environments well, and no additional learning cost is required, and the compatibility and ease of use are stronger. Moreover, compared with the keyboard on the screen of the traditional electronic device, it is not limited by the size of the electronic device screen, so it can improve the convenience of information input, and can input a large amount of text, thereby improving the efficiency of information input.
[0083] Optionally, the operating body is a finger, the second signal includes at least one reflection signal, and during the movement of the finger, a parameter value of a target parameter associated with each reflection signal changes, and the target parameter includes at least one of a reflection amplitude and a distance relative to a reflection position of the first signal;
[0084] Based on the first embodiment, after step 102, the method further includes:
[0085] Determining that the operating body is located at a first initial position of the preset operating area;
[0086] When the parameter value of the target parameter changes and the parameter value of the target parameter is restored to an initial value, it is determined that the operating body has the first input operation, and the initial value is the parameter value of the target parameter when the operating body is in the first initial position.
[0087] In this embodiment, the transmission signal of the radar antenna will generate a reflection signal after encountering the finger, and the reflection signal at each position of the finger will be different. Therefore, after the transmission signal is reflected by the finger, the electronic device can receive at least one reflection signal. In addition, during the movement of the finger, the parameter value of the target parameter associated with each reflection signal will change. The target parameter can be at least one of the reflection amplitude of the reflection signal and the transmission position of the first signal, that is, the distance between the corresponding position of the finger and the radar antenna.
[0088] In this embodiment, the determination of the finger action can be achieved by means of the coordinated operation of three reflection signals. The following takes the reflection signals at the upper, middle and lower positions of the finger as an example to illustrate how to determine the first input operation.
[0089] See also Figure 4 , Figure 4 is a schematic diagram for judging the first input operation, such as Figure 4 As shown, the electronic device is fixed on the desktop 402 by a bracket 401. The electronic device transmits a radar beam 403 to a preset operation area through an antenna at preset time intervals. A finger 404 is located in the preset operation area. The solid line in the figure indicates a state in which the finger 404 is in contact with the desktop 402, and the dotted line indicates a state in which the finger 404 is lifted.
[0090] In the initial state, the finger 404 is in contact with the desktop. Figure 4 As shown by the solid lines, the reflected signals at the top, middle and bottom positions of the finger are recorded as s R1 、s R2 and R3 , and its reflection amplitude can be recorded as A R1 , A R2 and A R3 , through the above formula (5), the distance information of the three positions can be determined, which are respectively denoted as l R1 , l R2 and l R2 .
[0091] After lifting your finger, Figure 4 As shown by the dotted lines, the reflected signals at the top, middle and bottom positions of the finger are recorded as s' R1 、s' R2 and s' R3 , and its reflection amplitude can be recorded as A' R1 , A' R2 and A' R3 , similarly, through the above formula (5), the distance information of the three positions can be determined, which are respectively denoted as l' R1 , l' R1 and l' R1 The reflection amplitude and distance information of the reflection signals at these three positions have changed compared to the initial state.
[0092] Finally, the finger falls down and contacts the desktop again, completing the tapping action. The reflected signals at the top, middle and bottom positions of the finger return to the initial state, i.e., s R1 、s R2 and R3 .
[0093] By judging the parameter values of target parameters (which may include reflection amplitude and / or distance information) associated with the reflection signals at the upper, middle and lower positions of the finger, it can be determined whether the finger has made a tapping action, that is, whether the first input operation has been performed.
[0094] In this embodiment, by judging the parameter value of the target parameter associated with the reflection signal at different positions of the finger, it is possible to judge whether the finger has performed the first input operation.
[0095] Optionally, step 103 specifically includes:
[0096] In the process of the parameter value of the target parameter changing, acquiring in real time a transmission position and a first time interval of the first signal, where the first time interval is a time interval between a transmission time of the first signal and a reception time of the second signal;
[0097] A first input position of the first input operation is determined based on the emission position and the first time interval, wherein the emission position is used to determine coordinate information of the first input position in a first direction, and the first time interval is used to determine coordinate information of the first input position in a second direction.
[0098] In this embodiment, during the real-time movement of the finger, the parameter value of the target parameter associated with the reflection signal of at least one position of the finger will change, and the transmission position of the transmission signal corresponding to the reflection signal of the finger performing the first input operation, as well as the time interval between the transmission time of the transmission signal and the reception time of the reflection signal, i.e., the first time interval, can be obtained in real time.
[0099] Afterwards, the first input position of the first input operation may be determined based on the transmission position and the first time interval. The coordinate information of the first input operation in the x direction may be determined based on the transmission position, and the coordinate information of the first input operation in the y direction may be determined based on the first time interval.
[0100] Specifically, there may be many scenarios in which users perform air input, for example, performing the first input operation at the initial position of the finger. In this scenario, the emission position of the first signal will not change, and the change in the first time interval is within a preset range. Accordingly, when it is detected that the finger has performed the first input operation, the position coordinates of the finger in contact with the desktop in the initial state can be obtained accordingly, and the position coordinates are the first input position of the first input operation.
[0101] For another example, the first input operation is performed at another position. In this scenario, during the movement of the finger, the change of the first time interval will exceed the preset range, and the change state may be to first decrease and then return to the initial position. At this time, the position when the first time interval is the smallest can be determined as the coordinate information of the first input operation in the y direction. For example, the initial position of the finger is the position of the character "A". When the user needs to input the character "Q", at this time, during the movement of the finger, the finger will perform the first input operation at the position of the character "Q". At this position, the first time interval changes to the minimum, and this position is the coordinate information of the first input operation in the y direction. Alternatively, the change state of the first time interval may also be to first increase and then return to the initial position. At this time, the position when the first time interval is the largest can be determined as the coordinate information of the first input operation in the y direction.
[0102] If the emission position of the first signal is detected to change during the movement of the finger, the coordinate information of the first input operation in the x direction may be the coordinate information at the extreme position of the change, that is, the minimum emission position or the maximum emission position.
[0103] In this embodiment, the emission position and the first time interval of the first signal are obtained in real time during the process of changes in the parameter value of the target parameter associated with the transmitted signal, and based on the emission position and the first time interval, the first input position of the first input operation can be determined, and then the first target input information corresponding to the first input operation can be determined, thereby realizing the input of the air keyboard.
[0104] Optionally, based on the first embodiment, step 104 specifically includes:
[0105] Based on the operating body being located at a first initial position of the preset operating area, adjusting the input position in the preset mapping relationship;
[0106] Based on the adjusted preset mapping relationship, the input information corresponding to the first input position is determined as the first target input information.
[0107] In this embodiment, in order to achieve the flexibility of air input, the position of the air keyboard may not be limited, and the position of the air keyboard is determined by determining that the finger is at the first initial position of the preset operation area during use.
[0108] The first initial position can be set according to the user's input habits. When the user uses the air keyboard function, the user can place the finger at any position in the preset operation area. When the finger is still, the electronic device can determine the position where the finger is still as the first initial position. Figure 3 As shown, the first initial position can default to the third row of the air keyboard.
[0109] Afterwards, after the first initial position is detected, the user can be prompted to use the air keyboard to input information, and detect whether the user has performed the first input operation. If not, continue to detect the initial position of the user's finger. If so, it is determined that the user has started to input information. According to the first initial position, adjust the input position in the preset mapping relationship to adjust the input position in the preset mapping relationship to a fixed input position for this air input.
[0110] For example, if the first initial position is (10, 20), the input information corresponding to the first initial position is the character "A", and the relative input position (1, 1) relative to the first initial position in the preset mapping relationship corresponds to the input information of the character "Z". Based on the first initial position, the relative input position in the preset mapping relationship can be adjusted to a fixed input position. After the adjustment, the input position (11, 21) in the preset mapping relationship can correspond to the input information of the character "Z".
[0111] Correspondingly, input information corresponding to the first input position can be obtained from the adjusted preset mapping relationship, and the input information is the first target input information corresponding to the first input operation.
[0112] In this embodiment, the position of the air keyboard is set according to the user's input habits, so that the flexibility of air input can be improved. In addition, based on the first initial position of the operating body in the preset operation area, the input position in the preset mapping relationship is adjusted; and based on the adjusted preset mapping relationship, the input information corresponding to the first input position is determined as the first target input information, so that the relative input position conversion for each input operation can be reduced, and the processing speed of air input can be improved.
[0113] Optionally, before step 101, the method further includes:
[0114] Determining that the operating body is located at a second initial position of the preset operating area;
[0115] detecting a second input operation performed by the operating body based on the calibration input information in the reference mapping relationship;
[0116] Determine a second input position of the operating body for performing a second input operation;
[0117] Determining second target input information corresponding to the second input operation based on the second input position and the reference mapping relationship;
[0118] When the calibration input information is different from the second target input information, the input position corresponding to the calibration input information in the reference mapping relationship is adjusted based on the relative distance information between the second input position and the second initial position to obtain the preset mapping relationship.
[0119] In this embodiment, since each person's input actions and habits are different, the mapping between finger actions and keyboard characters in the electronic device only serves as an initial mapping, and the correspondence between the input position and input information in the preset mapping relationship can be adjusted based on the user's calibration of the air input.
[0120] When the calibration function is turned on, a signal can be transmitted to the preset operation area through the antenna at preset time intervals; and a signal after the transmitted signal is reflected by the finger in the preset operation area is received; based on the transmitted signal and the reflected signal, it is determined that the finger is at a second initial position of the preset operation area, and the second input operation performed by the finger based on the calibration input information in the reference mapping relationship is detected.
[0121] Afterwards, the second input position of the finger performing the second input operation is determined, and based on the second input position and the reference mapping relationship, the second target input information corresponding to the second input operation is determined. If the calibration input information is different from the second target input information, it can be explained that the user's input action habits may not be consistent with the correspondence between the input position and the input information in the reference mapping relationship.
[0122] The electronic device can pre-adjust the input information corresponding to the second input position in the baseline mapping relationship based on the relative distance information between the second input position and the second initial position, and display the calibration input information again to allow the user to perform air input. If the input information determined this time is the same as the calibration input information, the preset mapping relationship can be finally obtained based on the adjusted baseline mapping relationship.
[0123] For details, see Figure 5 , Figure 5 It is a schematic diagram of the process of establishing the mapping relationship between finger movement habits and keyboard characters, such as Figure 5 As shown, the following steps are included:
[0124] Step 501: obtaining an initial mapping between finger movement habits and keyboard characters, that is, obtaining a preset mapping relationship;
[0125] Step 502: Display specific characters to allow the user to input them remotely;
[0126] Step 503: Is the character recognition accuracy higher than 98%? If yes, go to step 506; if no, go to step 504;
[0127] Step 504: Display specific characters to allow the user to input them remotely;
[0128] Step 505: Machine learning and updating the initial mapping; then jump to step 501;
[0129] Step 506: Establish a final mapping between finger movement habits and keyboard characters.
[0130] In this embodiment, through the calibration process, an air keyboard that conforms to the user's input actions and habits can be realized, thereby improving the user's flexibility in using the air keyboard and enhancing the user experience.
[0131] It should be noted that the information input method provided in the embodiment of the present application can be executed by an information input device or a control module in the information input device for executing the loading information input method. In the embodiment of the present application, the information input method provided in the embodiment of the present application is described by taking the information input device executing the loading information input method as an example.
[0132] See also Figure 6 , Figure 6 is a schematic diagram of the structure of the information input device provided in the embodiment of the present application, which is applied to electronic devices such as Figure 6 As shown, the information input device includes:
[0133] A transmitting module 601, configured to transmit a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device;
[0134] The receiving module 602 is configured to receive a second signal after the first signal is reflected by an operating body in the preset operating area;
[0135] A first determining module 603, configured to determine a first input position of the operating body performing a first input operation based on the first signal and the second signal;
[0136] The second determination module 604 is used to determine first target input information corresponding to the first input operation based on the first input position and a preset mapping relationship, where the preset mapping relationship is a correspondence between an input position and input information.
[0137] Optionally, the operating body is a finger, the second signal includes at least one reflection signal, and during the movement of the finger, a parameter value of a target parameter associated with each reflection signal changes, and the target parameter includes at least one of a reflection amplitude and a distance relative to a reflection position of the first signal; the device further includes:
[0138] A third determining module, used to determine that the operating body is located at a first initial position of the preset operating area;
[0139] The fourth determination module is used to determine that the operating body has the first input operation when the parameter value of the target parameter changes and the parameter value of the target parameter is restored to an initial value, and the initial value is the parameter value of the target parameter when the operating body is in the first initial position.
[0140] Optionally, the first determining module 603 includes:
[0141] an acquisition unit, configured to acquire, in real time, a transmission position and a first time interval of the first signal during a process in which a parameter value of the target parameter changes, wherein the first time interval is a time interval between a transmission time of the first signal and a reception time of the second signal;
[0142] A first determination unit is used to determine a first input position of the first input operation based on the emission position and the first time interval, the emission position is used to determine the coordinate information of the first input position in a first direction, and the first time interval is used to determine the coordinate information of the first input position in a second direction.
[0143] Optionally, the second determining module 604 includes:
[0144] An adjusting unit, configured to adjust an input position in the preset mapping relationship based on the first initial position of the operating body being located in the preset operating area;
[0145] The second determining unit is configured to determine the input information corresponding to the first input position as the first target input information based on the adjusted preset mapping relationship.
[0146] Optionally, the device further comprises:
[0147] A fifth determining module, configured to determine that the operating body is located at a second initial position of the preset operating area;
[0148] a detection module, configured to detect a second input operation performed by the operating body based on the calibration input information in the reference mapping relationship;
[0149] A sixth determining module, configured to determine a second input position where the operating body performs a second input operation;
[0150] a seventh determining module, configured to determine second target input information corresponding to the second input operation based on the second input position and a reference mapping relationship;
[0151] An adjustment module is used to adjust the input position corresponding to the calibration input information in the reference mapping relationship based on the relative distance information between the second input position and the second initial position when the calibration input information is different from the second target input information, so as to obtain the preset mapping relationship.
[0152] In the embodiment of the present application, the transmitting module 601 transmits a first signal to a preset operation area through an antenna at preset time intervals, and the preset operation area is a space area outside the electronic device; the receiving module 602 receives a second signal after the first signal is reflected by an operating body in the preset operation area; the first determining module 603 determines the first input position of the operating body for the first input operation based on the first signal and the second signal; and the second determining module 604 determines the first target input information corresponding to the first input operation based on the first input position and a preset mapping relationship, and the preset mapping relationship is the corresponding relationship between the input position and the input information. In this way, remote input can be realized, and it is not affected by the strength of the lighting environment, so the accuracy of information input can be improved.
[0153] The information input device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0154] The information input device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0155] The information input device provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented by the information input device in the method embodiment will not be described here.
[0156] Optionally, an embodiment of the present application also provides an electronic device, including a memory 701, a processor 702, and a program or instruction stored in the memory 701 and executable on the processor 702. When the program or instruction is executed by the processor 702, each process of the above-mentioned information input method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0157] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0158] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present application.
[0159] The electronic device 800 includes but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810 and other components.
[0160] Those skilled in the art will appreciate that the electronic device 800 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 810 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0161] The radio frequency unit 801 is configured to transmit a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device; and receive a second signal after the first signal is reflected by an operating body within the preset operation area;
[0162] Processor 810 is used to determine a first input position of the operating body performing a first input operation based on the first signal and the second signal; and determine a first target input information corresponding to the first input operation based on the first input position and a preset mapping relationship, wherein the preset mapping relationship is a correspondence between the input position and the input information.
[0163] In the embodiment of the present application, the RF unit 801 transmits a first signal to a preset operation area through an antenna at preset time intervals, and the preset operation area is a space area outside the electronic device; a second signal after the first signal is reflected by an operating body in the preset operation area is received; the processor 810 determines the first input position of the operating body for the first input operation based on the first signal and the second signal; based on the first input position and a preset mapping relationship, the first target input information corresponding to the first input operation is determined, and the preset mapping relationship is the corresponding relationship between the input position and the input information. In this way, remote input can be realized, and it is not affected by the strength of the lighting environment, so the accuracy of information input can be improved.
[0164] Optionally, the operating body is a finger, the second signal includes at least one reflection signal, and during the movement of the finger, a parameter value of a target parameter associated with each reflection signal changes, and the target parameter includes at least one of a reflection amplitude and a distance relative to a reflection position of the first signal;
[0165] Processor 810 is also used to determine that the operating body is located at a first initial position of the preset operating area; when the parameter value of the target parameter changes and the parameter value of the target parameter is restored to the initial value, it is determined that the operating body has the first input operation, and the initial value is the parameter value of the target parameter when the operating body is in the first initial position.
[0166] Optionally, the processor 810 is further used to obtain, in real time, a transmission position and a first time interval of the first signal during a change in the parameter value of the target parameter, the first time interval being the time interval between the transmission time of the first signal and the reception time of the second signal; and determine a first input position of the first input operation based on the transmission position and the first time interval, the transmission position being used to determine coordinate information of the first input position in a first direction, and the first time interval being used to determine coordinate information of the first input position in a second direction.
[0167] Optionally, the processor 810 is further used to adjust the input position in the preset mapping relationship based on the first initial position of the operating body in the preset operating area; based on the adjusted preset mapping relationship, determine the input information corresponding to the first input position as the first target input information.
[0168] Optionally, the processor 810 is further used to determine that the operating body is located at a second initial position of the preset operating area; detect a second input operation performed by the operating body based on the calibration input information in the reference mapping relationship; determine a second input position of the operating body for the second input operation; based on the second input position and the reference mapping relationship, determine second target input information corresponding to the second input operation; when the calibration input information is different from the second target input information, adjust the input position corresponding to the calibration input information in the reference mapping relationship based on the relative distance information between the second input position and the second initial position to obtain the preset mapping relationship.
[0169] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information input method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0170] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0171] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information input method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0172] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0173] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0174] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0175] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A method for inputting information, characterized in that: Used in electronic equipment, including: transmitting a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device; Receiving a second signal after the first signal is reflected by an operating body in the preset operating area; the operating body is a finger, and the second signal includes reflection signals of at least two positions of the same finger; Based on the first signal and the second signal, determining a first input position where the operating body performs a first input operation; wherein, when a parameter value of a target parameter associated with the reflection signal at each position of the same finger changes and the parameter value of the target parameter is restored to an initial value, it is determined that the operating body has performed the first input operation; the initial value is the parameter value of the target parameter when the operating body is at a first initial position of the preset operation area; the target parameter includes at least one of a reflection amplitude and a distance relative to the reflection position of the first signal; Based on the first input position and the adjusted preset mapping relationship, the first target input information corresponding to the first input operation is determined; wherein the preset mapping relationship is the correspondence between the input position and the input information; and the preset mapping relationship is adjusted using the first initial position of the operating body located in the preset operation area to obtain the adjusted preset mapping relationship.
2. The method according to claim 1, characterized in that The determining, based on the first signal and the second signal, a first input position of the operating body performing a first input operation includes: In the process of the parameter value of the target parameter changing, acquiring in real time a transmission position and a first time interval of the first signal, where the first time interval is a time interval between a transmission time of the first signal and a reception time of the second signal; A first input position of the first input operation is determined based on the emission position and the first time interval, wherein the emission position is used to determine coordinate information of the first input position in a first direction, and the first time interval is used to determine coordinate information of the first input position in a second direction.
3. The method according to claim 1, characterized in that Before transmitting the first signal to the preset operation area through the antenna at every preset time, the method further includes: Determining that the operating body is located at a second initial position of the preset operating area; detecting a second input operation performed by the operating body based on the calibration input information in the reference mapping relationship; Determine a second input position of the operating body for performing a second input operation; Determining second target input information corresponding to the second input operation based on the second input position and the reference mapping relationship; When the calibration input information is different from the second target input information, the input position corresponding to the calibration input information in the reference mapping relationship is adjusted based on the relative distance information between the second input position and the second initial position to obtain the preset mapping relationship.
4. An information input device, characterized in that: Used in electronic equipment, including: A transmitting module, configured to transmit a first signal to a preset operation area through an antenna at a preset time interval, wherein the preset operation area is a space area outside the electronic device; A receiving module, configured to receive a second signal after the first signal is reflected by an operating body in the preset operating area; the operating body is a finger, and the second signal includes reflection signals of at least two positions of the same finger; a first determination module, configured to determine a first input position of the operating body performing a first input operation based on the first signal and the second signal; wherein, when a parameter value of a target parameter associated with a reflection signal at each position of the same finger changes and the parameter value of the target parameter is restored to an initial value, it is determined that the operating body has performed the first input operation; the initial value is the parameter value of the target parameter when the operating body is at a first initial position of the preset operation area; the target parameter includes at least one of a reflection amplitude and a distance relative to a reflection position of the first signal; A second determination module is used to determine the first target input information corresponding to the first input operation based on the first input position and the adjusted preset mapping relationship; wherein the preset mapping relationship is the correspondence between the input position and the input information; and the preset mapping relationship is adjusted by using the first initial position of the operating body in the preset operation area to obtain the adjusted preset mapping relationship.
5. The device according to claim 4, characterized in that The first determining module comprises: an acquisition unit, configured to acquire, in real time, a transmission position and a first time interval of the first signal during a process in which a parameter value of the target parameter changes, wherein the first time interval is a time interval between a transmission time of the first signal and a reception time of the second signal; A first determination unit is used to determine a first input position of the first input operation based on the emission position and the first time interval, the emission position is used to determine the coordinate information of the first input position in a first direction, and the first time interval is used to determine the coordinate information of the first input position in a second direction.
6. The device according to claim 4, characterized in that The device also includes: A fifth determining module, configured to determine that the operating body is located at a second initial position of the preset operating area; a detection module, configured to detect a second input operation performed by the operating body based on the calibration input information in the reference mapping relationship; A sixth determining module, configured to determine a second input position where the operating body performs a second input operation; a seventh determining module, configured to determine second target input information corresponding to the second input operation based on the second input position and a reference mapping relationship; An adjustment module is used to adjust the input position corresponding to the calibration input information in the reference mapping relationship based on the relative distance information between the second input position and the second initial position when the calibration input information is different from the second target input information, so as to obtain the preset mapping relationship.
7. An electronic device, characterized in that: The method comprises a processor, a memory and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the information input method as claimed in any one of claims 1 to 3.
8. A readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the information input method according to any one of claims 1 to 3 are implemented.
