Input method and apparatus, electronic device, and storage medium

Abstract

The present application discloses an input method and apparatus, an electronic device, and a storage medium. The input method comprises: in response to a first input to a second electronic device, calling a soft keyboard; using the second electronic device to acquire action data of a target object; and on the basis of the action data, driving corresponding keys on the soft keyboard to perform character input.

Description

Input method, device, electronic device and storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on December 25, 2023, with application number 202311805222.6 and invention name “Input method, device, electronic device and storage medium”. The entire contents of the Chinese patent application are incorporated herein by reference. Technical Field

[0003] The embodiments of the present application relate to the field of terminal technology, and in particular to an input method, device, electronic device, and storage medium. Background Art

[0004] With the continuous development of science and technology, terminal electronic products are becoming increasingly popular, and smart terminal devices such as smart TVs have entered people's daily lives. However, due to the different usage scenarios of these products, some scenarios require keyboards for character input, while others do not. Therefore, these smart terminals do not always have hardware keyboards for input like computers, but at the same time, character input is inevitable. As a result, the character input problem of smart terminal devices is becoming increasingly serious.

[0005] In some scenarios, projection keyboards are often used to input characters on smart devices. However, projection keyboards are large and inconvenient to carry. This type of keyboard generally projects a virtual keyboard on a contact surface. When a finger clicks a key on the virtual keyboard, it is determined that the key has been pressed. However, this type of projection keyboard has a major flaw. It needs to accurately detect the position of the projected key where the user's finger presses it to determine whether the key has been pressed. However, when the projection keyboard is located on a non-contact surface such as the back of the user's hand, it is impossible to accurately detect the key pressed by the finger. Moreover, when the light of the virtual keyboard projected by the projection keyboard is nearly parallel to the projection contact surface, the projected virtual keyboard is almost impossible to form an image and is severely deformed, making it impossible to input keys. As a result, the use of a projected virtual keyboard for character input has great limitations, resulting in a poor user experience.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide an input method, device, and terminal that can solve the problem of significant limitations in character input using a projected virtual keyboard.

[0008] In a first aspect, an input method is provided, comprising: invoking a soft keyboard in response to a first input to a second electronic device; obtaining motion data of a target object using the second electronic device; and driving corresponding keys on the soft keyboard to input characters according to the motion data.

[0009] In a second aspect, an input device is provided, including: a first electronic device and a second electronic device, the first electronic device and the second electronic device are connected; the second electronic device is used to obtain action data of a target object; the first electronic device is used to call a soft keyboard in response to a first input to the second electronic device, and drive corresponding keys on the soft keyboard to input characters according to the action data obtained by the second electronic device.

[0010] In a third aspect, an input device is provided, including: a calling module for calling the soft keyboard of the first electronic device in response to a first input to the second electronic device; an acquisition module for using the second electronic device to obtain action data of the target object; and an input module for driving the corresponding keys on the soft keyboard to input characters according to the action data.

[0011] In a fourth aspect, an electronic device is provided, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method of the first aspect are implemented.

[0012] In a fifth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0013] In a sixth aspect, a chip is provided, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method of the first aspect.

[0014] In a seventh aspect, a computer program / program product is provided. The computer program / program product is stored in a storage medium, and the computer program / program product is executed by at least one processor to implement the steps of the input method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] FIG1 shows a schematic structural diagram of an input device provided in an embodiment of the present application.

[0016] FIG2 is a schematic diagram showing an application scenario provided by an embodiment of the present application;

[0017] FIG3 shows a schematic diagram of a soft keyboard provided in an embodiment of the present application;

[0018] FIG4 is a schematic diagram showing a scenario of a first position of a soft keyboard provided in an embodiment of the present application;

[0019] FIG5 is a coordinate diagram of a coordinate origin provided by an embodiment of the present application;

[0020] FIG6 is a schematic diagram showing a second position of a soft keyboard according to an embodiment of the present application;

[0021] FIG7 is a schematic diagram showing coordinates of a starting position and an ending position provided in an embodiment of the present application;

[0022] FIG8 is a schematic diagram showing a flow chart of an input method provided in an embodiment of the present application;

[0023] FIG9 is a schematic structural diagram of another input device provided in an embodiment of the present application;

[0024] FIG10 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0026] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects. For example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0027] FIG1 shows a block diagram of an input device applicable to an embodiment of the present application. The input device 10 includes a first electronic device 11 and a second electronic device 12. The first electronic device 11 and the second electronic device 12 are connected, which can be a wireless connection or a wired connection. Among them, the first electronic device 11 can be a mobile phone, a tablet computer (Tablet Personal Computer), a laptop computer (Laptop Computer) or a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile Internet device (Mobile Internet Device, MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device (Wearable Device), a vehicle-mounted device (VUE), a pedestrian terminal (PUE), a game console, a personal computer (PC), a teller machine or a self-service machine and other terminal-side devices, and the wearable device includes: a smart watch, a smart bracelet, a smart headset, a smart glass, a smart wristband, a smart clothing, etc. It should be noted that the embodiment of the present application does not limit the type of the first electronic device 11. It can be any type of terminal with a display screen and a soft keyboard in its own system. The second electronic device 12 can be a wearable device, such as a smart ring, a smart watch, a smart bracelet, and a smart wristband.

[0028] For the first electronic device 11 and the second electronic device 12, the second electronic device 12 is used to obtain the motion data of the target object, and the first electronic device 11 is used to call the soft keyboard in response to the first input to the second electronic device 12, and drive the corresponding keys on the soft keyboard to input characters based on the motion data obtained by the second electronic device 12. As an alternative embodiment, the call of the soft keyboard can also be initiated by the first electronic device 11, and then the soft keyboard is operated in response to the information of the second electronic device.

[0029] The target object can be a movable object such as a finger, wrist, or electronic pen. The target object's motion data includes, but is not limited to, predetermined motions of the target object and movement data of the target object. The predetermined motions include, but are not limited to, clicking, rotating, and sliding upwards. The movement data includes, but is not limited to, movement direction and movement distance. As shown in FIG2 , taking the target object as a finger and the second electronic device 12 as a smart ring as an example, the smart ring can be worn on the user's finger. When the finger moves on the contact surface, the smart ring can collect the motion data of the finger. After establishing a connection between the first electronic device 11 and the second electronic device 12, the user can perform a first input on the second electronic device 12. The first input can be turning on a switch button on the second electronic device 12. Turning on the switch button of the second electronic device 12 indicates turning on the input function of the second electronic device 12, thereby invoking the soft keyboard on the first electronic device 11. Alternatively, clicking a virtual button on the soft keyboard of the second electronic device indicates turning on the input function of the second electronic device 12. Clicking the virtual button indicates invoking the soft keyboard on the first electronic device 11. The form of the soft keyboard can be as shown in FIG3 . Furthermore, after the user performs a first input on the second electronic device 12 , the soft keyboard of the first electronic device is called and displayed on the first electronic device.

[0030] Furthermore, after calling the soft keyboard on the first electronic device 11, the corresponding key on the soft keyboard on the first electronic device 11 is determined based on the action data of the target object obtained by the second electronic device for character input. For example, a user wears a smart ring on a finger, and the finger clicks a certain position on a contact surface (the contact surface can be a desktop, the back of the hand, the palm of the hand, a wall, etc.). The second electronic device detects the finger clicking, and the second electronic device determines the position where the finger clicked as the starting position. Then, the finger moves a distance from the starting position to the right on the contact surface and stops. The finger clicks twice at the position where the finger stopped on the contact surface. The second electronic device determines the position where the finger clicked twice as the ending position. The second electronic device sends the starting position, ending position, movement direction, and movement distance to the first electronic device. The first electronic device maps the starting position to the corresponding position on the soft keyboard as the coordinate origin. Starting from the coordinate origin, the soft keyboard cursor moves in the movement direction and the movement distance to the target position on the soft keyboard. The first electronic device executes the click action of the key corresponding to the target position according to the two click actions of the user's finger to input the character. It is worth noting that the type of action data can also be determined according to actual conditions, and the embodiments of the present application do not limit this.

[0031] The second electronic device 12 includes, but is not limited to, a power module, an image acquisition module, an accelerometer, a microphone, a vibration sensor, a distance sensor, a gyroscope, a magnetic sensor, a communication module, a memory, and a processor. The image acquisition module may be a camera, which is used to capture image data of a target object during movement. The target object may be a finger, an electronic pen, or a wrist. The accelerometer is used to capture acceleration data of the target object during movement. The microphone is used to capture sound data of the target object as it performs a predetermined action. The vibration sensor is used to capture vibration data of the target object as it performs a predetermined action. The gyroscope is used to obtain posture data of the target object.

[0032] Through the technical solution provided in the embodiment of the present application, by responding to the first input to the second electronic device, the soft keyboard is called, and then the action data of the target object is obtained by using the second electronic device, and finally the corresponding keys on the soft keyboard are driven to input characters according to the action data. In this way, the soft keyboard of the first electronic device is called by the second electronic device. Since the soft keyboard is the first electronic device itself, there is no restriction on the usage environment. It only needs to obtain the action data of the target object through the second electronic device to drive the corresponding keys on the soft keyboard on the first electronic device to input characters. Compared with the strict requirements of the projection keyboard on the projection contact plane, calling the software disk of the first electronic device for character input has fewer limitations, which improves the user experience.

[0033] In one possible implementation, the second electronic device includes an acceleration sensor, a microphone, and a vibration sensor; the microphone and the vibration sensor are used to obtain a first predetermined action and a second predetermined action of the target object, the first predetermined action marks the starting position of the target object's action, and the second predetermined action marks the ending position of the target object's action; the acceleration sensor is used to collect acceleration data of the target object moving from the starting position to the ending position; the second electronic device is also used to determine the moving direction and moving distance of the target object based on the acceleration data, the starting position, and the ending position, and the action data includes the first predetermined action, the second predetermined action, the moving direction, and the moving distance.

[0034] Among them, the first predetermined action and the second predetermined action can be rotation, clicking the contact plane N times, etc., N is a natural number greater than or equal to 1. When the target object performs the first predetermined action, it marks the starting position of the target object's movement. For example, when the user's finger clicks the contact plane three times, the finger collides with the contact plane, and the sound of the collision is detected by the pickup, and the vibration of the collision is detected by the vibration sensor. The second electronic device locates the contact point of the finger performing the action as the starting position. Immediately afterwards, the target object starts to move from a standstill at the starting position, and performs the second predetermined action after the movement is completed, marking the end position of the target object's movement. For example, when the user's finger clicks the contact plane once, the finger collides with the contact plane, and the sound of the collision is detected by the pickup, and the vibration of the collision is detected by the vibration sensor. The second electronic device locates the contact point of the finger performing the action as the end position.

[0035] Furthermore, the accelerometer can be used to measure the movement and direction of the target object. The acceleration data includes the duration of the target object's movement from the starting position to the ending position, the magnitude of the acceleration during the target object's movement, and the direction of the acceleration. The second electronic device determines the target object's movement direction based on the direction of the acceleration, and determines the target object's movement distance based on the direction, magnitude, and duration of the target acceleration. In this way, the position and direction of the target object detected by the accelerometer are only the relative position and relative movement of the target object. It does not require an absolute position and there is no projected virtual keyboard. This avoids the problem of absolute positioning error and improves the efficiency and accuracy of character input.

[0036] In one possible implementation, the second predetermined action may also be that the target object slides after leaving the contact plane for a first predetermined distance. For example, the user lifts the finger and slides 1-2 cm away from the contact plane, and slides the key corresponding to the end position on the soft keyboard through air sliding. Furthermore, the sliding input is exited after the target object leaves the contact plane for a second predetermined distance. If the user lifts the finger again for 2-3 cm, the sliding input ends.

[0037] In one possible implementation, the second electronic device includes an acceleration sensor, a microphone, a vibration sensor, and an image acquisition module; the microphone and the vibration sensor are used to obtain a first predetermined action and a second predetermined action of the target object, the first predetermined action marks the starting position of the target object's action, and the second predetermined action marks the ending position of the target object's action; the image acquisition module is used to collect image data of the target object moving from the starting position to the ending position; the second electronic device is also used to determine the moving direction and moving distance of the target object based on the image data, the starting position, and the ending position, and the action data includes the first predetermined action, the second predetermined action, the moving direction, and the moving distance.

[0038] Among them, the first predetermined action and the second predetermined action can be rotation, clicking the contact plane N times, etc., N is a natural number greater than or equal to 1. When the target object performs the first predetermined action, it marks the starting position of the target object's movement. For example, when the user's finger clicks the contact plane three times, the finger collides with the contact plane, and the sound of the collision is detected by the pickup, and the vibration of the collision is detected by the vibration sensor. The second electronic device locates the contact point of the finger performing the action as the starting position. Immediately afterwards, the target object starts to move from a standstill at the starting position, and performs the second predetermined action after the movement is completed, marking the end position of the target object's movement. For example, when the user's finger clicks the contact plane once, the finger collides with the contact plane, and the sound of the collision is detected by the pickup, and the vibration of the collision is detected by the vibration sensor. The second electronic device locates the contact point of the finger performing the action as the end position.

[0039] In one possible implementation, the second predetermined action may also be that the target object slides after leaving the contact plane for a first predetermined distance. For example, the user lifts the finger and slides 1-2 cm away from the contact plane, and slides the key corresponding to the end position on the soft keyboard through air sliding. Furthermore, the sliding input is exited after the target object leaves the contact plane for a second predetermined distance. If the user lifts the finger again for 2-3 cm, the sliding input ends.

[0040] Furthermore, the image acquisition module can be a camera, which acquires image data of the target object at the starting position, and acquires image data of the target object in the process of moving from the starting position to the ending position in real time, as well as image data of the target object at the ending position. The image data includes the texture, image brightness and pattern on the contact plane, etc. The image data of the target object at the starting position, the image data during the movement, and the image data at the ending position acquired by the camera are compared with the pre-set image of the entire contact plane to determine the moving direction and moving distance of the target object. In this way, the position and moving direction of the target object acquired by the image acquisition module are only the relative position and relative movement of the target object. It does not require an absolute position and there is no projected virtual keyboard. This avoids the problem of absolute positioning error and improves the efficiency and accuracy of character input.

[0041] In one possible implementation, the first electronic device is also used to determine that the starting position is mapped to the first position on the soft keyboard; move a moving distance from the first position to a second position on the soft keyboard according to the moving direction; and input characters to the key corresponding to the second position according to a second predetermined action.

[0042] In which, the first electronic device maps the starting position of the target object to the corresponding first position on the soft keyboard as the coordinate origin, and drives the soft keyboard cursor to move the moving distance in the moving direction from the coordinate origin to reach the second position on the soft keyboard. The first electronic device performs the second predetermined action of the key corresponding to the second position to input characters according to the second predetermined action performed by the target object.

[0043] For example, a user wears a smart ring on their finger, and the finger taps a certain location on a contact surface (the contact surface can be a table, the back of the hand, the palm of the hand, a wall, etc.). The second electronic device detects the finger tapping, and then determines the location where the finger tapped once as the starting location. Then, the finger moves a distance to the right on the contact surface from the starting location and stops, and taps twice at the location where the finger stopped on the contact surface. The second electronic device then determines the location where the finger tapped twice as the ending location. The second electronic device sends the starting location, ending location, movement direction, and movement distance to the first electronic device.

[0044] The first electronic device maps the starting position of the finger to the corresponding first position on the soft keyboard as the coordinate origin. As shown in Figure 4, the cursor is at the position of key 5, which is the position corresponding to the coordinate origin. The coordinate origin is at FO as shown in Figure 5. Starting from the position of key 5, the soft keyboard cursor is driven to move in the moving direction and the moving distance to reach the second position on the soft keyboard. For example, the second position is the position of the WXYZ key as shown in Figure 6. The first electronic device executes the click action of the key corresponding to the second position to input characters based on the two click actions performed by the user's finger. For example, as shown in Figure 7, the smart ring detects that the starting position of the finger is position M1 (fx1, fy1), and the smart ring detects that the ending position of the finger is position M2 (fx2, fy2). The displacement between the starting position and the ending position is as follows.

[0045] dx=fx2-fx1

[0046] dy=fy2-fy1

[0047] Wherein, dx is the displacement in the FX direction, and dy is the displacement in the FY direction.

[0048] As shown in Figure 6, the first position is N1, which corresponds to the starting position M1, and the second position is N2, which corresponds to the ending position M2. The user performs a first predetermined action to define the starting position M1 of the finger. The user slides the finger 1.414 cm to the lower right, that is, slides 1 cm to the right and then slides 1 cm downward and stops, ending at position M2. The smart ring detects the direction and distance of the finger movement and sends these directions and distances to the second electronic device. The second electronic device drives the cursor from the first position N1 corresponding to the starting position M1 to the second position N2 corresponding to the ending position M2.

[0049] In one possible implementation, the first electronic device includes a display screen, and the first electronic device is further used to determine the moving pixels corresponding to the moving distance based on a mapping relationship between a preset moving distance of the target object and a preset moving pixel of the display screen; and to move the moving pixels from a first position to a second position on the soft keyboard according to the moving direction.

[0050] Furthermore, in order to enable the cursor to move accurately on the software keyboard, a mapping relationship between the moving distance of the target object and the pixels on the display screen of the second electronic device may be established. The mapping relationship may be expressed by the following formula.

[0051] cx2=cx1+dx*σ1

[0052] cy2=cy1-dy*σ1

[0053] Among them, σ1 is the proportional coefficient, which represents the ratio between the actual moving distance of the target object and the pixels of the display screen, that is, the actual moving distance of the target object is proportional to the pixels of the display screen. σ1 can be determined according to actual conditions and is not limited in this embodiment of the present application. The minus sign is used before dy*σ1 here because the Y-axis coordinate direction of Figure 6 is opposite to the Y-axis coordinate direction of Figure 7.

[0054] For example, a user wears a smart ring on the index finger of his right hand and activates the input function of the smart ring. The smart ring is connected to a terminal device. The terminal device displays a soft keyboard and defines the cursor position. The user makes a preset gesture to define the starting position of the index finger. The user's right index finger slides 1.414 cm to the lower right, that is, slides 1 cm to the right and stops after sliding 1 cm downward. The smart ring detects the direction and distance of the finger movement. In this embodiment, the proportional coefficient σ1=1 is taken. When σ1=1, moving 1 cm is equivalent to moving 100 pixels on the display screen, that is, dx=100, dy=-100.

[0055] The original position of the cursor on the display screen is cx1 = 500 pixels, cy1 = 600 pixels. After the user slides his finger 1 cm to the right and 1 cm downward, the cursor also moves a certain number of pixels on the display screen. The corresponding new position on the display screen is as follows.

[0056] cx2=cx1+dx*σ1=500+100*1=600

[0057] cy2=cy1-dy*σ1=600-(-100)*1=700

[0058] It is worth noting that if the pixel to which the cursor moves on the display screen cannot reach the corresponding key on the soft keyboard, the proportional coefficient can be increased, such as σ1=1.5, or σ1=2, etc., and vice versa.

[0059] In one feasible implementation, after the second predetermined action is completed, the starting position of the target object is updated to the location of the contact point where the user performed the second predetermined action on the contact plane. The first position on the soft keyboard is also updated. For example, the position of the WXYZ keys in Figure 6 is updated to the first position (i.e., the coordinate origin). This is used as the coordinate origin for the next finger movement detection. In this way, the detection errors of each target object movement are not accumulated, thereby improving the accuracy of input.

[0060] In one feasible embodiment, when the second electronic device detects a third predetermined action of the target object, the input function of the second electronic device is turned off, that is, the soft keyboard of the first electronic device is stopped. The third predetermined action can be a gesture of the target object to end input (for example, on the contact surface, the user's finger clicks the contact surface three times in a row, or rotates the finger, or touches a special position of the second electronic device (which can be a switch button of the second electronic device or a virtual button on the display screen of the second electronic device that turns off the input function)), and the first electronic device side no longer drives the cursor to move on the soft keyboard.

[0061] The input method provided in the embodiments of the present application is described in detail below through some embodiments and their application scenarios in conjunction with the accompanying drawings.

[0062] As shown in FIG8 , an embodiment of the present application provides an input method, which can be executed by a first electronic device. In other words, the method can be executed by software or hardware installed on the first electronic device. The method includes the following steps.

[0063] Step S801: In response to a first input to a second electronic device, calling a soft keyboard.

[0064] Among them, the user can make a first input to the second electronic device, wherein the first input can be turning on a switch button on the second electronic device, turning on the switch button of the second electronic device indicates turning on the input function of the second electronic device, thereby calling the soft keyboard on the first electronic device, or clicking a virtual button on the soft keyboard of the second electronic device indicates turning on the input function of the second electronic device, and clicking the virtual button indicates calling the soft keyboard on the first electronic device. Further, after the user makes a first input to the second electronic device, the soft keyboard of the first electronic device is called and the soft keyboard is displayed on the first electronic device. The second electronic device can be a wearable device, such as a smart ring, a smart watch, a smart bracelet, and a smart wristband. Further, after the user makes a first input to the second electronic device, the soft keyboard of the first electronic device is called and the soft keyboard is displayed on the first electronic device.

[0065] Step S803: Acquire the motion data of the target object using the second electronic device.

[0066] The target object may be a movable object such as a finger, wrist, or electronic pen. The target object's motion data includes, but is not limited to, predetermined motions of the target object and movement data of the target object. Predetermined motions include, but are not limited to, clicking, rotating, and swiping upwards. Movement data includes, but is not limited to, movement direction and movement distance. As shown in FIG. 2 of the above embodiment, taking the target object as a finger and the second electronic device as a smart ring as an example, the smart ring can be worn on the user's finger. When the finger moves, the smart ring can collect the motion data of the finger.

[0067] In one possible implementation, a second electronic device is used to obtain a first predetermined action and a second predetermined action of a target object, where the first predetermined action marks the starting position of the target object's action, and the second predetermined action marks the ending position of the target object's action; the second electronic device is used to collect acceleration data of the target object moving from the starting position to the ending position; the second electronic device is used to determine the moving direction and moving distance of the target object, where the moving direction and moving distance are determined by the second electronic device based on the acceleration data, the starting position, and the ending position, and the action data includes the first predetermined action, the second predetermined action, the moving direction, and the moving distance.

[0068] Among them, the first predetermined action and the second predetermined action can be rotation, clicking the contact plane N times, etc., where N is a natural number greater than or equal to 1. When the target object performs the first predetermined action, it marks the starting position of the target object's movement. For example, when the user's finger clicks the contact plane three times, the finger collides with the contact plane, and the second electronic device locates the contact point of the finger performing the action as the starting position. Immediately afterwards, the target object starts to move from a stationary state at the starting position, and performs the second predetermined action after the movement is completed, marking the end position of the target object's movement. For example, when the user's finger clicks the contact plane once, the finger collides with the contact plane, and the second electronic device locates the contact point of the finger performing the action as the end position.

[0069] Furthermore, the acceleration data includes the duration of time it takes for the target object to move from its starting position to its ending position, the magnitude of the acceleration during the target object's movement, and the direction of the acceleration. The second electronic device determines the target object's direction of movement based on the direction of the acceleration, and determines the target object's distance of movement based on the direction, magnitude, and duration of the acceleration. In this way, the position and direction of movement of the target object detected by the second electronic device are merely the relative position and relative movement of the target object. Absolute position is not required, and there is no projected virtual keyboard. This avoids the problem of absolute positioning errors and improves character input efficiency and accuracy.

[0070] In one possible implementation, using a second electronic device to obtain motion data of a target object includes: using the second electronic device to obtain a first predetermined motion and a second predetermined motion of the target object, the first predetermined motion marks the starting position of the target object's motion, and the second predetermined motion marks the ending position of the target object's motion; using the second electronic device to collect image data of the target object moving from the starting position to the ending position; using the second electronic device to determine the moving direction and moving distance of the target object, the moving direction and moving distance are determined by the second electronic device based on the image data, the starting position, and the ending position, and the motion data includes the first predetermined motion, the second predetermined motion, the moving direction, and the moving distance.

[0071] Among them, the first predetermined action and the second predetermined action can be rotation, clicking the contact plane N times, etc., where N is a natural number greater than or equal to 1. When the target object performs the first predetermined action, it marks the starting position of the target object's movement. For example, when the user's finger clicks the contact plane three times, the finger collides with the contact plane, and the second electronic device locates the contact point of the finger performing the action as the starting position. Immediately afterwards, the target object starts to move from a stationary state at the starting position, and performs the second predetermined action after the movement is completed, marking the end position of the target object's movement. For example, when the user's finger clicks the contact plane once, the finger collides with the contact plane, and the second electronic device locates the contact point of the finger performing the action as the end position.

[0072] In one possible implementation, the second predetermined action may be a sliding motion after the target object leaves the contact plane by a first predetermined distance. For example, the user lifts their finger 1-2 cm away from the contact plane and slides, thereby performing a mid-air sliding input on the soft keyboard corresponding to the end position. Furthermore, the sliding input is terminated after the target object leaves the contact plane by a second predetermined distance, such as when the user lifts their finger again by 2-3 cm, and the sliding input ends.

[0073] Furthermore, the image data includes image data of the target object at its starting position, image data of the target object during its movement from the starting position to the ending position, and image data of the target object at its ending position. The image data includes texture, image brightness, and pattern on the contact plane. The image data of the target object at its starting position, image data during its movement, and image data at its ending position are compared with a pre-set image of the entire contact plane to determine the target object's direction of movement and distance of movement. In this way, the position and direction of movement of the target object are merely the relative position and relative movement of the target object. There is no need for an absolute position and no projected virtual keyboard. This avoids the problem of absolute positioning errors and improves the efficiency and accuracy of character input.

[0074] Step S805: driving corresponding keys on the soft keyboard according to the action data to input characters.

[0075] Among them, the starting position of the target object is mapped to the corresponding position on the soft keyboard as the coordinate origin, and the cursor of the soft keyboard is driven to move the moving distance in the moving direction from the coordinate origin to reach the final position on the soft keyboard. According to the second predetermined action performed by the target object, the key corresponding to the second position is driven to input characters.

[0076] In one possible implementation, driving the corresponding keys on the soft keyboard to input characters according to action data includes: determining that the starting position is mapped to the first position on the soft keyboard; moving a distance from the first position to a second position on the soft keyboard according to the moving direction; and inputting characters to the key corresponding to the second position according to a second predetermined action.

[0077] Map the starting position of the target object to the corresponding first position on the soft keyboard as the coordinate origin, and drive the soft keyboard cursor from the coordinate origin to move the moving distance in the moving direction to reach the second position on the soft keyboard. According to the second predetermined action performed by the target object, execute the second predetermined action of the key corresponding to the second position to input characters.

[0078] For example, a user wears a smart ring on their finger, and the finger taps a certain location on a contact surface (the contact surface can be a table, the back of the hand, the palm of the hand, a wall, etc.). The second electronic device detects the finger tapping, and then determines the location where the finger tapped once as the starting location. Then, the finger moves a distance to the right on the contact surface from the starting location and stops, and taps twice at the location where the finger stopped on the contact surface. The second electronic device then determines the location where the finger tapped twice as the ending location. The second electronic device sends the starting location, ending location, movement direction, and movement distance to the first electronic device.

[0079] The first electronic device maps the starting position of the finger to the corresponding first position on the soft keyboard as the coordinate origin. As shown in Figure 4, the position of the cursor at key 5 is the position corresponding to the coordinate origin. The coordinate origin is at FO as shown in Figure 5. Starting from the coordinate origin, the soft keyboard cursor is driven to move in the moving direction and the moving distance to the second position on the soft keyboard. For example, the second position is the position of the WXYZ key as shown in Figure 6. The first electronic device executes the click action of the key corresponding to the second position to input characters based on the two click actions performed by the user's finger. For example, as shown in Figure 7, the smart ring detects that the starting position of the finger is position M1 (fx1, fy1), and the smart ring detects that the ending position of the finger is position M2 (fx2, fy2). The displacement between the starting position and the ending position is as follows.

[0080] dx=fx2-fx1

[0081] dy=fy2-fy1

[0082] Wherein, dx is the displacement in the FX direction, and dy is the displacement in the FY direction.

[0083] As shown in Figure 6, the first position is N1, which corresponds to the starting position M1, and the second position is N2, which corresponds to the ending position M2. The user performs a first predetermined action to define the starting position M1 of the finger. The user slides the finger 1.414 cm to the lower right, that is, slides 1 cm to the right and then slides 1 cm downward and stops, ending at position M2. The smart ring detects the direction and distance of the finger movement and sends these directions and distances to the second electronic device. The second electronic device drives the cursor from the first position N1 corresponding to the starting position M1 to the second position N2 corresponding to the ending position M2.

[0084] In one possible implementation, moving a moving distance from a first position to a second position on a soft keyboard according to a moving direction includes: determining a moving pixel corresponding to the moving distance based on a mapping relationship between a preset moving distance of a target object and a preset moving pixel of a display screen; and moving the moving pixel from a first position to a second position on the soft keyboard according to the moving direction.

[0085] In order to enable the cursor to move accurately on the software keyboard, a mapping relationship between the moving distance of the target object and the pixels on the display screen of the second electronic device may be established. The mapping relationship may be expressed by the following formula.

[0086] cx2=cx1+dx*σ1

[0087] cy2=cy1-dy*σ1

[0088] Among them, σ1 is the proportional coefficient, which represents the ratio between the actual moving distance of the target object and the pixels of the display screen, that is, the actual moving distance of the target object is proportional to the pixels of the display screen. σ1 can be determined according to actual conditions and is not limited in this embodiment of the present application. The minus sign is used before dy*σ1 here because the Y-axis coordinate direction of Figure 6 is opposite to the Y-axis coordinate direction of Figure 7.

[0089] For example, a user wears a smart ring on the index finger of his right hand and activates the input function of the smart ring. The smart ring is connected to a terminal device. The terminal device displays a soft keyboard and defines the cursor position. The user makes a preset gesture to define the starting position of the index finger. The user's right index finger slides 1.414 cm to the lower right, that is, slides 1 cm to the right and stops after sliding 1 cm downward. The smart ring detects the direction and distance of the finger movement. In this embodiment, the proportional coefficient σ1=1 is taken. When σ1=1, moving 1 cm is equivalent to moving 100 pixels on the display screen, that is, dx=100, dy=-100.

[0090] The original position of the cursor on the display screen is cx1 = 500 pixels, cy1 = 600 pixels. After the user slides his finger 1 cm to the right and 1 cm downward, the cursor also moves a certain number of pixels on the display screen. The corresponding new position on the display screen is as follows.

[0091] cx2=cx1+dx*σ1=500+100*1=600

[0092] cy2=cy1-dy*σ1=600-(-100)*1=700

[0093] It is worth noting that if the pixel to which the cursor moves on the display screen cannot reach the corresponding key on the soft keyboard, the proportional coefficient may be increased, such as σ1=1.5, or σ1=2, etc., and vice versa.

[0094] Through the technical solution disclosed in the embodiments of the present application, by responding to the first input to the second electronic device, the soft keyboard is called, and then the action data of the target object is obtained by using the second electronic device, and finally the corresponding keys on the soft keyboard are driven to input characters according to the action data. In this way, the soft keyboard of the first electronic device is called by the second electronic device. Since the soft keyboard is the first electronic device itself, there is no restriction on the usage environment. It only needs to obtain the action data of the target object through the second electronic device to drive the corresponding keys on the soft keyboard on the first electronic device to input characters. Compared with the strict requirements of the projection keyboard on the projection contact plane, calling the software disk of the first electronic device for character input has fewer limitations, which improves the user experience.

[0095] In one feasible implementation, after the second predetermined action is completed, the starting position of the target object is updated to the location of the contact point where the user performed the second predetermined action on the contact plane. The first position on the soft keyboard is also updated. For example, the position of the WXYZ keys in Figure 6 is updated to the first position (i.e., the coordinate origin). This is used as the coordinate origin for the next finger movement detection. In this way, the detection errors of each target object movement are not accumulated, thereby improving the accuracy of input.

[0096] In one feasible embodiment, when the second electronic device detects a third predetermined action of the target object, the input function of the second electronic device is turned off, that is, the soft keyboard of the first electronic device is stopped. The third predetermined action can be a gesture of the target object to end input (for example, on the contact surface, the user's finger clicks the contact surface three times in a row, or rotates the finger, or touches a special position of the second electronic device (which can be a switch button of the second electronic device or a virtual button on the display screen of the second electronic device that turns off the input function)), and the first electronic device side no longer drives the cursor to move on the soft keyboard.

[0097] It should be noted that the input method provided in the embodiment of the present application can be executed by an input device. In the embodiment of the present application, the input device executing the loading input method is taken as an example to illustrate the data processing device provided in the embodiment of the present application.

[0098] Figure 9 is a schematic diagram of the structure of an input device according to an embodiment of the present application. As shown in Figure 9, input device 900 includes: a calling module 901 for calling a soft keyboard of a first electronic device in response to a first input to a second electronic device; an acquisition module 902 for acquiring motion data of a target object using the second electronic device; and an input module 903 for driving corresponding keys on the soft keyboard to input characters based on the motion data.

[0099] In an embodiment of the present application, a soft keyboard is called in response to a first input to a second electronic device, and then the action data of the target object is obtained by using the second electronic device. Finally, the corresponding keys on the soft keyboard are driven to input characters according to the action data. In this way, the soft keyboard of the first electronic device is called by the second electronic device. Since the soft keyboard is the first electronic device itself, there is no restriction on the usage environment. Only the action data of the target object obtained by the second electronic device is needed to drive the corresponding keys on the soft keyboard on the first electronic device to input characters. Compared with the strict requirements of the projection keyboard on the projection contact plane, calling the software disk of the first electronic device for character input has fewer limitations, thereby improving the user experience.

[0100] In one possible implementation, the acquisition module 902 is also used to use the second electronic device to obtain the first predetermined action and the second predetermined action of the target object, the first predetermined action marks the starting position of the target object's action, and the second predetermined action marks the ending position of the target object's action; use the second electronic device to collect acceleration data of the target object moving from the starting position to the ending position; use the second electronic device to determine the moving direction and moving distance of the target object, the moving direction and moving distance are determined by the second electronic device based on the acceleration data, the starting position and the ending position, and the action data includes the first predetermined action, the second predetermined action, the moving direction and the moving distance.

[0101] In one possible implementation, the acquisition module 902 is also used to use a second electronic device to obtain a first predetermined action and a second predetermined action of the target object, where the first predetermined action marks the starting position of the target object's action, and the second predetermined action marks the ending position of the target object's action; use the second electronic device to collect image data of the target object moving from the starting position to the ending position; use the second electronic device to determine the moving direction and moving distance of the target object, where the moving direction and moving distance are determined by the second electronic device based on the image data, the starting position and the ending position, and the action data includes the first predetermined action, the second predetermined action, the moving direction and the moving distance.

[0102] In one possible implementation, the input module 903 is also used to determine that the starting position is mapped to the first position on the soft keyboard; move a moving distance from the first position to the second position on the soft keyboard according to the moving direction; and input characters for the key corresponding to the second position according to the second predetermined action.

[0103] In one possible implementation, the input module 903 is further used to determine the moving pixels corresponding to the moving distance based on a mapping relationship between a preset moving distance of the target object and a preset moving pixel of the display screen; and to move the moving pixels from a first position to a second position on the soft keyboard according to the moving direction.

[0104] The input device provided in the embodiment of the present application can implement each process implemented in the method embodiment of Figure 8 and achieve the same technical effect. To avoid repetition, it will not be described here.

[0105] As shown in Figure 10, an embodiment of the present application also provides an electronic device 1000, including a processor 1001 and a memory 1002, and the memory 1002 stores a program or instruction that can be run on the processor 1001. When the program or instruction is executed by the processor 1001, the various steps of the above-mentioned input method embodiment are implemented and the same technical effect can be achieved.

[0106] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned input method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0107] The processor is the processor in the terminal in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0108] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned input method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0109] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0110] The embodiments of the present application further provide a computer program / program product, which is stored in a storage medium. The computer program / program product is executed by at least one processor to implement the various processes of the above-mentioned input method embodiments and can achieve the same technical effects. To avoid repetition, they will not be described here.

[0111] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0112] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods of each embodiment of the present application.

[0113] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned implementation methods. The above-mentioned implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An input method, applied to a first electronic device, the input method comprising: Invoking a soft keyboard in response to a first input to a second electronic device; Obtaining motion data of a target object by using the second electronic device; Driving corresponding keys on the soft keyboard to perform character input according to the motion data.

2. The input method according to claim 1, wherein, The obtaining motion data of the target object by using the second electronic device includes: Obtaining a first predetermined motion and a second predetermined motion of the target object by using the second electronic device, where the first predetermined motion indicates a starting position of the target object's motion, and the second predetermined motion indicates an ending position of the target object's motion; Collecting acceleration data of the target object moving from the starting position to the ending position by using the second electronic device; Determining a moving direction and a moving distance of the target object by using the second electronic device, where the moving direction and the moving distance are determined by the second electronic device according to the acceleration data, the starting position, and the ending position, and the motion data includes the first predetermined motion, the second predetermined motion, the moving direction, and the moving distance.

3. The input method according to claim 1, wherein, The obtaining motion data of the target object by using the second electronic device includes: Obtaining a first predetermined motion and a second predetermined motion of the target object by using the second electronic device, where the first predetermined motion indicates a starting position of the target object's motion, and the second predetermined motion indicates an ending position of the target object's motion; Collecting image data of the target object moving from the starting position to the ending position by using the second electronic device; Determining a moving direction and a moving distance of the target object by using the second electronic device, where the moving direction and the moving distance are determined by the second electronic device according to the image data, the starting position, and the ending position, and the motion data includes the first predetermined motion, the second predetermined motion, the moving direction, and the moving distance.

4. The input method according to claim 2 or 3, wherein, The driving corresponding keys on the soft keyboard to perform character input according to the motion data includes: Determining a first position on the soft keyboard where the starting position is mapped; Moving the moving distance from the first position on the soft keyboard in the moving direction to a second position; Performing character input on the key corresponding to the second position according to the second predetermined motion.

5. The input method according to claim 4, wherein, The moving the moving distance from the first position on the soft keyboard in the moving direction to a second position includes: Determining moving pixels corresponding to the moving distance according to a mapping relationship between a preset moving distance of the target object and preset moving pixels of a display screen; Moving the moving pixels from the first position on the soft keyboard in the moving direction to the second position.

6. An input device, the input device comprising: A first electronic device and a second electronic device, the first electronic device and the second electronic device are connected; The second electronic device is configured to obtain motion data of a target object; The first electronic device is configured to call up a soft keyboard in response to a first input to the second electronic device, and drive corresponding keys on the soft keyboard to perform character input according to the motion data acquired by the second electronic device.

7. The input device according to claim 6, wherein, The second electronic device includes an acceleration sensor, a pickup, and a vibration sensor; The pickup and the vibration sensor are configured to acquire a first predetermined motion and a second predetermined motion of the target object, where the first predetermined motion indicates the starting position of the target object's motion, and the second predetermined motion indicates the ending position of the target object's motion; The acceleration sensor is configured to collect acceleration data of the target object moving from the starting position to the ending position; The second electronic device is further configured to determine the moving direction and moving distance of the target object according to the acceleration data, the starting position, and the ending position, and the motion data includes the first predetermined motion, the second predetermined motion, the moving direction, and the moving distance.

8. The input device according to claim 6, wherein, The second electronic device includes an acceleration sensor, a pickup, a vibration sensor, and an image acquisition module; The pickup and the vibration sensor are configured to acquire a first predetermined motion and a second predetermined motion of the target object, where the first predetermined motion indicates the starting position of the target object's motion, and the second predetermined motion indicates the ending position of the target object's motion; The image acquisition module is configured to collect image data of the target object moving from the starting position to the ending position; The second electronic device is further configured to determine the moving direction and moving distance of the target object according to the image data, the starting position, and the ending position, and the motion data includes the first predetermined motion, the second predetermined motion, the moving direction, and the moving distance.

9. The input device according to claim 7 or 8, wherein The first electronic device is further configured to determine a first position on the soft keyboard where the starting position is mapped; Move the moving distance from the first position on the soft keyboard in the moving direction to a second position; Perform character input on the key corresponding to the second position according to the second predetermined motion.

10. The input device according to claim 9, wherein, The first electronic device includes a display screen, and the first electronic device is further configured to determine moving pixels corresponding to the moving distance according to the mapping relationship between the preset moving distance of the target object and the preset moving pixels of the display screen; Move the moving pixels from the first position on the soft keyboard in the moving direction to the second position.

11. An input device, the input device includes: A calling module, configured to call up the soft keyboard of the first electronic device in response to a first input to the second electronic device; An acquisition module, configured to acquire motion data of a target object by using the second electronic device; An input module, configured to drive corresponding keys on the soft keyboard to perform character input according to the motion data.

12. An electronic device, including a processor and a memory, where the memory stores a program or instruction that can run on the processor, and when the program or instruction is executed by the processor, the steps of the input method according to any one of claims 1 to 5 are implemented.

13. A readable storage medium, on which a program or instructions are stored, and when the program or instructions are executed by a processor, the steps of the input method described in any one of claims 1 to 5 are implemented.

Images