Input method, device and device for input

By detecting and processing the contact positions during handwriting input in real time, determining the display point position that deviates from the contact position and presenting the contact movement trajectory, the problem of low input efficiency and accuracy caused by line of sight occlusion in handwriting input is solved, and a more efficient and accurate input experience is achieved.

CN114637454BActive Publication Date: 2025-03-25BEIJING SOGOU TECHNOLOGY DEVELOPMENT CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202011494268.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-16
Publication Date
2025-03-25
Estimated Expiration
2040-12-16

AI Technical Summary

Technical Problem

The prior art has low input efficiency and accuracy due to occlusion of line of sight during handwriting input.

Method used

By detecting the contact position during the user's handwriting input process in real time, the display point position deviates from the contact position based on the contact position and user-related information, and presents the contact movement trajectory based on the display point position.

Benefits of technology

This allows users to see complete strokes in real time during handwriting input, improving input efficiency and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114637454B_ABST
    Figure CN114637454B_ABST
Patent Text Reader

Abstract

The embodiment of the present application discloses an input method, device and device for input. The embodiment of the method includes: detecting the touch point position of the user in the handwriting input process in real time; determining the display point position based on the touch point position and user-related information, and the display point position deviates from the touch point position; and presenting the contact point movement trajectory based on the display point position. This implementation improves the efficiency and accuracy of handwriting input.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to an input method, device, and a device for input. Background Art

[0002] With the development of computer technology, the functions of input method applications are becoming more and more abundant. When users use input method applications to input content, they can use not only encoding input methods but also handwriting input methods.

[0003] In the prior art, when inputting content by handwriting or other methods, the strokes are usually rendered at the touch point, so the strokes are blocked by the touch screen medium. As a result, the user cannot see the complete strokes in real time during the handwriting input process, resulting in low input efficiency and accuracy. Summary of the invention

[0004] The embodiments of the present application provide an input method, an apparatus, and a device for input to solve the technical problem in the prior art of low input efficiency and low input accuracy due to line of sight occlusion during handwriting input.

[0005] In a first aspect, an embodiment of the present application provides an input method, the method comprising: detecting in real time the contact point position during the user's handwriting input process; determining a display point position based on the contact point position and user-related information, the display point position deviating from the contact position; and presenting a contact movement trajectory based on the display point position.

[0006] In some embodiments, the user-related information includes a preset position offset defined by the user; and determining the display point position based on the touch point position and the user-related information includes: determining the display point position based on the touch point position and the preset position offset.

[0007] In some embodiments, the user-related information includes real-time touch screen information; and determining the display point position based on the touch point position and the user-related information includes: determining a target position offset based on the real-time touch screen information; determining the display point position based on the touch point position and the target position offset.

[0008] In some embodiments, the real-time touch screen information includes at least one of the following: touch screen mode, touch point pressure, and touch point area.

[0009] In some embodiments, the touch screen mode includes at least one of the following: left-hand touch screen, right-hand touch screen, and both-hand touch screen.

[0010] In some embodiments, determining the target position offset based on the real-time touch screen information includes: predicting the touch screen medium size of the user based on the contact pressure and the contact area; determining the direction of the display point position relative to the touch point position based on the touch screen mode; and determining the target position offset based on the touch screen medium size and the direction.

[0011] In some embodiments, the method further includes: monitoring the touch screen duration when a user's touch screen operation on the handwriting input panel is detected; and hiding or weakening the display of the operation buttons in the handwriting input panel when the touch screen duration reaches a first preset value.

[0012] In some embodiments, the method further includes: when it is detected that the touch screen operation stops, monitoring the touch screen stop duration; when the touch screen stop duration reaches a second preset value, restoring the display of the hidden or weakened operation button.

[0013] In a second aspect, an embodiment of the present application provides an input device, which includes: an acquisition unit, configured to detect in real time the contact position of a user during handwriting input; a determination unit, configured to determine a display point position based on the contact position and user-related information, wherein the display point position deviates from the contact position; and a presentation unit, configured to present a contact movement trajectory based on the display point position.

[0014] In some embodiments, the user-related information includes a preset position offset defined by the user; and the determination unit is further configured to determine a display point position based on the touch point position and the preset position offset.

[0015] In some embodiments, the user-related information includes real-time touch screen information; and the determination unit is further configured to: determine a target position offset based on the real-time touch screen information; and determine a display point position based on the touch point position and the target position offset.

[0016] In some embodiments, the real-time touch screen information includes at least one of the following: touch screen mode, touch point pressure, and touch point area.

[0017] In some embodiments, the touch screen mode includes at least one of the following: left-hand touch screen, right-hand touch screen, and both-hand touch screen.

[0018] In some embodiments, the determination unit is further configured to: predict the touch screen media size of the user based on the contact pressure and the contact area; determine the direction of the display point position relative to the touch point position based on the touch screen method; and determine the target position offset based on the touch screen media size and the direction.

[0019] In some embodiments, the device also includes: a first detection unit, configured to monitor the touch screen duration when detecting a user's touch screen operation on the handwriting input panel; when the touch screen duration reaches a first preset value, hide or weaken the display of the operation buttons in the handwriting input panel.

[0020] In some embodiments, the device also includes: a second detection unit, configured to monitor the touch screen stop duration when it is detected that the touch screen operation stops; when the touch screen stop duration reaches a second preset value, the hidden or weakened operation button is restored to display.

[0021] In a third aspect, an embodiment of the present application provides a device for input, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations: real-time detection of the touch point position during the user's handwriting input process; determining a display point position based on the touch point position and user-related information, the display point position deviating from the touch point position; and presenting a touch point movement trajectory based on the display point position.

[0022] In some embodiments, the user-related information includes a preset position offset defined by the user; and determining the display point position based on the touch point position and the user-related information includes: determining the display point position based on the touch point position and the preset position offset.

[0023] In some embodiments, the user-related information includes real-time touch screen information; and determining the display point position based on the touch point position and the user-related information includes: determining a target position offset based on the real-time touch screen information; determining the display point position based on the touch point position and the target position offset.

[0024] In some embodiments, the real-time touch screen information includes at least one of the following: touch screen mode, touch point pressure, and touch point area.

[0025] In some embodiments, the touch screen mode includes at least one of the following: left-hand touch screen, right-hand touch screen, and both-hand touch screen.

[0026] In some embodiments, determining the target position offset based on the real-time touch screen information includes: predicting the touch screen medium size of the user based on the contact pressure and the contact area; determining the direction of the display point position relative to the touch point position based on the touch screen mode; and determining the target position offset based on the touch screen medium size and the direction.

[0027] In some embodiments, the device is configured to execute one or more programs including instructions for performing the following operations by one or more processors: when a user's touch screen operation on a handwriting input panel is detected, monitoring the touch screen duration; when the touch screen duration reaches a first preset value, hiding or weakening the display of the operation buttons in the handwriting input panel.

[0028] In some embodiments, the device is configured to execute one or more programs including instructions for performing the following operations by one or more processors: when it is detected that the touch screen operation stops, monitoring the touch screen stop duration; when the touch screen stop duration reaches a second preset value, restoring the display of the hidden or weakened operation buttons.

[0029] In a fourth aspect, an embodiment of the present application provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect above.

[0030] The input method, device and device for input provided by the embodiments of the present application detect the touch point position of the user in the handwriting input process in real time, and then determine the display point position deviating from the touch point position based on the touch point position and user-related information, and finally present the touch point movement trajectory based on the display point position, so that the displayed touch point movement trajectory (i.e., the stroke input by the user) can be deviated from the user touch point, avoiding the touch screen medium covering and blocking the displayed stroke. As a result, the user can see the complete stroke in real time during the handwriting input process, which improves the input efficiency and input accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0032] Figure 1 is a flow chart of an embodiment of an input method according to the present application;

[0033] Figure 2 is a schematic diagram of an application scenario of the input method according to the present application;

[0034] Figure 3 is a schematic diagram of a process of hiding operation keys of a handwriting input panel according to the present application;

[0035] Figure 4 is a schematic diagram of the operation button display process of the handwriting input panel according to the present application;

[0036] Figure 5 is a schematic structural diagram of an embodiment of an input device according to the present application;

[0037] Figure 6 is a schematic structural diagram of a device for input according to the present application;

[0038] Figure 7 It is a schematic diagram of the structure of the server in some embodiments of the present application. DETAILED DESCRIPTION

[0039] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It should also be noted that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0040] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0041] Please refer to Figure 1 , which shows a process 100 of an embodiment of the input method according to the present application. The above input method can be run on various electronic devices, including but not limited to: servers, smart phones, tablet computers, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop computers, car computers, desktop computers, set-top boxes, smart TVs, wearable devices (such as adult smart watches, children's smart watches, etc.), etc.

[0042] The input method application mentioned in the embodiment of the present application can support multiple input methods. Among them, the input method can be a coding method used to input various symbols into electronic devices such as computers and mobile phones. Users can use the input method application to conveniently input the required characters or strings into electronic devices. It should be noted that in the embodiment of the present application, in addition to supporting common Chinese input methods (such as pinyin input method, Wubi input method, Zhuyin input method, voice input method, handwriting input method, etc.), the input method can also support input methods of other languages ​​(such as English input method, Japanese Hiragana input method, Korean input method, etc.), and no limitation is made on the input method and the language type of the input method.

[0043] The input method in this embodiment may include the following steps:

[0044] Step 101: Detect the touch point position of the user during handwriting input in real time.

[0045] In this embodiment, the execution subject of the input method (such as the above-mentioned electronic device) may be installed with an input method application (i.e., an input method client). The input method application may have a handwriting input function. After the handwriting input function is started, a handwriting input panel may be displayed in the input method interface. The user may perform handwriting input in the handwriting input panel.

[0046] During the process of handwriting input by the user, the above-mentioned execution subject can detect the user's touch point position in real time. The touch point is the touch point of the user in the handwriting input panel. The touch point position can be represented by coordinates. For example, a rectangular coordinate system can be established with a certain point of the display screen (such as the upper left corner fixed point) as the origin, and the coordinates of the touch point position in the rectangular coordinate system can be obtained, thereby obtaining the touch point position represented by the coordinates.

[0047] It should be noted that, during the process of handwriting input by the user, the contact point position usually changes in real time. The above execution subject can obtain the contact point position in real time during the process of handwriting input by the user, thereby obtaining multiple continuous contact point positions.

[0048] It should be noted that the user can perform handwriting input directly through fingers, or through other auxiliary tools (such as a stylus, etc.), or through other parts of the body (such as elbows, nose, chin, feet, etc.). This embodiment does not specifically limit the medium for user handwriting input.

[0049] It should also be noted that the content of handwriting input is not specifically limited in the present embodiment of the application, for example, it may include but is not limited to: text, numbers, emoticons, symbols, images, etc.

[0050] Step 102, based on the touch point position and user related information, determine the display point position, the display point position deviates from the touch point position.

[0051] In this embodiment, the execution subject may first obtain user-related information, and then determine in real time the display point position that is offset from the touch point position based on the touch point position and user-related information detected in real time in step 101. Each touch point position obtained in real time by the execution subject may correspond to a display point position. The display point is a point in the handwriting input panel.

[0052] Among them, the user-related information may include various information related to the user, such as the user's configuration information in the input method client, historical information, real-time touch screen information, touch screen media information, etc. The above-mentioned execution subject may determine the display point position based on one or more of the user-related information. For example, the historical information may include the historical position offset between the touch point position of the user's historical handwriting input and the display point position. The execution subject may determine the current display point position based on the historical position offset and the contact point position of the current real-time detected contact point. For another example, the touch screen media information may include information such as the contact surface size between the touch screen medium and the screen. The correspondence between the contact surface size and the offset can be pre-set so that the larger the contact surface size, the larger the offset.

[0053] Since there is an offset between the display point position and the touch point position, the user's touch point position can be prevented from coinciding with the display point position, thereby preventing the user's touch screen medium from blocking the user's line of sight. As a result, the user can see the complete stroke in real time so as to accurately draw the stroke, thereby improving the accuracy of handwriting input content and input efficiency.

[0054] In some optional implementations of the present embodiment, the user-related information may include a preset position offset defined by the user. The preset position offset may refer to the offset between the touch point position and the display point position. The above-mentioned execution entity may determine the display point position based on the touch point position and the preset position offset. As an example, the position offset may be the coordinate difference between the touch point position and the display point position, which may include the horizontal coordinate difference and the vertical coordinate difference. At this time, the coordinate of the touch point position may be added to the coordinate difference to obtain the display point position. For example, if the coordinates of the touch point position are (A, B) and the position offset is (C, D), the coordinates of the display point position are (A+C, B+D).

[0055] By pre-defining the position offset by the user, the user can configure the display point position to the preferred position according to his / her input habits, thereby improving the accuracy of the handwriting input content while meeting the user's personalized handwriting input needs.

[0056] In some optional implementations of this embodiment, the position offset between the touch point position and the display point position can also be automatically calculated by the above-mentioned execution subject. Specifically, the above-mentioned user-related information may include real-time touch screen information. Real-time touch screen information may include but is not limited to at least one of the following: touch screen mode, touch point pressure, and touch point area. Among them, the touch screen mode may include but is not limited to at least one of the following: left-hand touch screen, right-hand touch screen, and two-hand touch screen. Here, the left-hand touch screen can refer to touching the screen with the left hand as the touch screen medium, or it can refer to touching the screen by controlling the touch screen medium (such as a touch pen, etc.) with the left hand. The right-hand touch screen can refer to touching the screen with the right hand as the touch screen medium, or it can refer to touching the screen by controlling the touch screen medium (such as a touch pen, etc.) with the right hand. The two-hand touch screen can refer to touching the screen with both hands as the touch screen medium, or it can refer to touching the screen by controlling the touch screen medium (such as controlling two touch pens at the same time). The above-mentioned execution subject can determine the display point position corresponding to each touch point position through the following sub-steps S11 to S12:

[0057] Sub-step S11, determining the target position offset based on the real-time touch screen information.

[0058] Here, the correspondence between the real-time touch screen information and the target position offset may be preset, so that based on the correspondence, the position offset corresponding to the current real-time touch screen information is queried, and the queried position offset is used as the target position offset.

[0059] As an example, the real-time touch screen information may include the touch screen mode. The correspondence between different touch screen modes and position offsets may be preset, so that based on the touch screen mode in the real-time touch screen information, the target position offset may be obtained by querying the correspondence. In practice, the correspondence may specifically include a first position offset corresponding to the left-hand touch screen mode, a second position offset corresponding to the right-hand touch screen mode, and a third position offset corresponding to the two-hand touch screen mode. The display point position calculated using the first position offset may be located above the right side of the touch point position to avoid the display point position being blocked by the user's left hand. The display point position calculated using the second position offset may be located above the left side of the touch point position to facilitate the display point position being blocked by the user's right hand. The display point position calculated using the third position offset may be located directly above the touch point position to facilitate the display point position being blocked by the user's hands. For example, a rectangular coordinate system is established with the upper left vertex of the display screen as the origin. If the first position offset is (200, -50), the second position offset may be (-200, -50) and the third position offset may be (0, -50). It should be noted that the relative position relationship between the display point position and the touch point position under different touch screen modes is not limited to the above description, and other settings can be made as needed.

[0060] As another example, real-time touch screen information may include contact pressure. The relationship between contact pressure and position offset may be preset, so that the contact pressure value may be input into the relationship to obtain the target position offset. Among them, the contact pressure and the position offset may be positively correlated, that is, the greater the contact pressure, the greater the position offset. The above relationship may be preset through a large number of experiments and data statistics, and is not specifically limited here. It is understandable that in order to avoid the target position offset jumping due to changes in contact pressure during the user's manual input process, the initial contact pressure of the user during this manual input may be used to determine the target position offset, thereby obtaining a fixed target position offset to ensure that the displayed strokes match the trajectory drawn by the user.

[0061] As another example, real-time touch screen information may include the touch area. The relationship between the touch area and the position offset may be preset, so that the touch area value may be input into the relationship to obtain the target position offset. Among them, the touch area and the position offset may be positively correlated. That is, the larger the touch area, the larger the position offset. The above relationship may be preset through a large number of experiments and data statistics, and is not specifically limited here. It is understandable that in order to avoid the target position offset jumping due to the change of the touch area during the manual input of the user, the initial touch area of ​​the user during the manual input can be used to determine the target position offset, thereby obtaining a fixed target position offset to ensure that the displayed strokes match the trajectory drawn by the user.

[0062] As another example, the real-time touch screen information may include both the contact pressure and the contact area. The relationship between the contact pressure, the contact area and the position offset may be preset, so that the contact pressure value and the contact area value may be simultaneously input into the relationship to obtain the target position offset. Among them, the contact pressure and the contact area may be positively correlated with the position offset, respectively. The above relationship may be preset through a large number of experiments and data statistics, and is not specifically limited here.

[0063] As another example, the real-time touch screen information may include the touch screen mode, the touch point pressure and the touch point area. In this case, the target position offset may be determined according to the following steps:

[0064] First, based on the contact pressure and contact area, predict the user's touch screen media size. Among them, the touch screen media may include but are not limited to body parts such as fingers, noses, mouths, feet, elbows, and handwriting tools such as touch pens. The touch screen media size can be obtained based on a pre-trained touch screen media size prediction model. The above-mentioned execution subject can input the contact pressure and contact area into the model to obtain the predicted touch screen media size. The above-mentioned touch screen media size prediction model can be pre-trained using a machine learning method (such as a supervised learning method). For example, a sample set can be obtained first, and the sample set contains a large number of samples, each sample is a triple, and the triple includes contact pressure, contact area and touch screen media size. Then, the contact pressure and contact area in the sample are used as input, and the touch screen media size is used as output to train the touch screen media size prediction model.

[0065] Then, based on the touch screen mode, the direction of the display point position relative to the touch point position is determined. Please refer to the description in the above example, which will not be repeated here.

[0066] Finally, the target position offset is determined based on the touch screen medium size and the direction of the display point position relative to the touch point position. Here, the correspondence between the touch screen medium size and the position offset can be preset. For example, the touch screen medium size can be positively correlated with the position offset. This correspondence can be preset through a large number of experiments and data statistics, and is not specifically limited here. Through this correspondence, the position offset can be queried. Then, based on the direction of the display point position relative to the touch point position, the positive and negative values ​​of the position offset are determined, thereby obtaining the final target position offset.

[0067] For example, a rectangular coordinate system is established with the upper left fixed point of the display screen as the origin, with the horizontal direction being the x-axis and the vertical direction being the y-axis. If the display point position is to the upper right of the touch point position when the left hand touches the screen, the x-direction component of the target position offset may be positive, and the y-direction component of the target position offset may be negative. If the display point position is to the upper left of the touch point position when the right hand touches the screen, the x-direction component of the target position offset may be negative, and the y-direction component of the target position offset may be negative. If the display point position is to the upper left of the touch point position when the right hand touches the screen, the x-direction component of the target position offset may be zero, and the y-direction component of the target position offset may be negative.

[0068] Sub-step S12, determining the display point position based on the touch point position and the target position offset.

[0069] The step of determining the display point position here is substantially the same as the step of determining the display point position based on the touch point position and the preset position offset in the above optional implementation manner, and will not be described in detail here.

[0070] By automatically calculating the target position offset, the user does not need to customize the target position offset in advance, thereby improving the convenience of handwriting input.

[0071] Step 103: presenting the contact point movement trajectory based on the display point position.

[0072] In this embodiment, since the user's touch point moves in real time during the handwriting input process, a touch point movement trajectory can be formed. Since each touch point has a corresponding display point, the touch point movement trajectory can be presented after the display points determined in sequence are displayed separately. Therefore, the above-mentioned execution subject can render the pixels at the display point position according to the preset style, thereby presenting the touch point movement trajectory, which is the stroke input by the user. Figure 2 In the schematic diagram of the application scenario shown, when a user writes a stroke in the handwriting input panel, the stroke input by the user can be presented in the left area deviating from the user's real-time touch position, thereby avoiding the stroke being blocked by the user's hand.

[0073] In some optional implementations of this embodiment, during the process of handwriting input by the user, the above-mentioned execution subject can detect the user's touch screen operation on the handwriting input panel and the touch screen stop operation. When the user's touch screen operation on the handwriting input panel is detected, the touch screen duration can be monitored. When the touch screen duration reaches a first preset value (such as 300 milliseconds), the operation buttons in the handwriting input panel, such as keyboard switching buttons, voice input buttons, Chinese and English switching buttons, line break buttons, punctuation buttons, etc., can be hidden or weakened. Among them, the weakened display can be displayed with a preset lower transparency. As a result, the operation buttons in the handwriting input panel can be automatically hidden or weakened after the user starts writing, thereby providing a larger handwriting area to facilitate the user's handwriting operation.

[0074] As an example, Figure 3 1 is a schematic diagram of the operation button hiding process of the handwriting input panel according to the present application. When the user does not perform handwriting input, the handwriting input panel includes multiple operation buttons. When the user starts to input, the operation buttons are displayed in a weakened manner.

[0075] In some optional implementations of this embodiment, when the touch screen operation stops, the execution subject may monitor the touch screen stop time. When the touch screen stop time reaches a second preset value (e.g., 300 milliseconds), the hidden or weakened operation button may be restored to display, thereby facilitating the execution of other operations after the user completes handwriting input.

[0076] As an example, Figure 4 Schematic diagram of the operation key display process of the handwriting input panel according to the present application. After the user puts down the pen, the weakened operation key is restored to display.

[0077] The method provided by the above-mentioned embodiment of the present application detects the touch point position of the user in the handwriting input process in real time, and then determines the display point position deviating from the touch point position based on the touch point position and user-related information, and finally presents the touch point movement trajectory based on the display point position, so that the displayed strokes can be deviated from the user's touch point, avoiding the user's touch screen medium covering and blocking the displayed strokes. As a result, the user can see the complete strokes in real time during the handwriting input process, which improves the input efficiency and input accuracy.

[0078] Further references Figure 5 As an implementation of the methods shown in the above figures, the present application provides an embodiment of an input device, and the device embodiment is Figure 1 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0079] like Figure 5 As shown, the input device 500 mentioned above in this embodiment includes: an acquisition unit 501, configured to detect the contact position of the user during the handwriting input process in real time; a determination unit 502, configured to determine the display point position based on the above-mentioned contact point position and user-related information, and the above-mentioned display point position deviates from the above-mentioned contact position; a presentation unit 503, configured to present the contact movement trajectory based on the display point position.

[0080] In some optional implementations of this embodiment, the user-related information includes the user-defined preset position offset; and the determination unit 502 is further configured to: determine the display point position based on the touch point position and the preset position offset.

[0081] In some optional implementations of this embodiment, the above-mentioned user-related information includes real-time touch screen information; and the above-mentioned determination unit 502 is further configured to: determine the target position offset based on the above-mentioned real-time touch screen information; determine the display point position based on the above-mentioned touch point position and the above-mentioned target position offset.

[0082] In some optional implementations of this embodiment, the above-mentioned real-time touch screen information includes at least one of the following: touch screen mode, contact point pressure, and contact point area.

[0083] In some optional implementations of this embodiment, the above-mentioned touch screen mode includes but is not limited to at least one of the following: left-hand touch screen, right-hand touch screen.

[0084] In some optional implementations of this embodiment, the above-mentioned determination unit 502 is further configured to: predict the touch screen media size of the above-mentioned user based on the above-mentioned contact pressure and the above-mentioned contact area; determine the direction of the display point position relative to the above-mentioned touch point position based on the above-mentioned touch screen method; determine the target position offset based on the above-mentioned touch screen media size and the above-mentioned direction.

[0085] In some optional implementations of this embodiment, the above-mentioned device also includes a first detection unit, which is configured to: monitor the touch screen duration when a user's touch screen operation on the handwriting input panel is detected; when the above-mentioned touch screen duration reaches a first preset value, hide or weaken the display of the operation buttons in the above-mentioned handwriting input panel.

[0086] In some optional implementations of this embodiment, the above-mentioned device also includes a second detection unit, which is configured to: monitor the touch screen stop duration when it is detected that the above-mentioned touch screen operation is stopped; when the above-mentioned touch screen stop duration reaches a second preset value, restore the display of the hidden or weakened operation buttons.

[0087] The device provided by the above-mentioned embodiment of the present application detects the touch point position of the user in the handwriting input process in real time, and then determines the display point position deviating from the touch point position based on the touch point position and user-related information, and finally presents the touch point movement trajectory based on the display point position, so that the displayed strokes can be deviated from the user's touch point, avoiding the user's touch screen medium covering and blocking the displayed strokes. As a result, the user can see the complete strokes in real time during the handwriting input process, which improves the input efficiency and accuracy.

[0088] Figure 6 6 is a block diagram of a device 600 for input according to an exemplary embodiment, and the device 600 may be a smart terminal or a server. For example, the device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0089] Reference Figure 6 , the device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .

[0090] The processing component 602 generally controls the overall operation of the device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0091] The memory 604 is configured to store various types of data to support operations on the device 600. Examples of such data include instructions for any application or method operating on the device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0092] The power supply component 606 provides power to the various components of the device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 600.

[0093] The multimedia component 608 includes a screen that provides an output interface between the above-mentioned device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The above-mentioned touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the above-mentioned touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0094] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the device 600 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.

[0095] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0096] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the device 600. For example, the sensor assembly 614 can detect the open / closed state of the device 600, the relative positioning of the components, such as the display and keypad of the device 600, the sensor assembly 614 can also detect the position change of the device 600 or a component of the device 600, the presence or absence of user contact with the device 600, the orientation or acceleration / deceleration of the device 600 and the temperature change of the device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0097] The communication component 616 is configured to facilitate wired or wireless communication between the device 600 and other devices. The device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0098] In an exemplary embodiment, the apparatus 600 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0099] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the instructions can be executed by a processor 620 of the device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0100] Figure 7 7 is a schematic diagram of the structure of the server in some embodiments of the present application. The server 700 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 722 (for example, one or more processors) and a memory 732, and one or more storage media 730 (for example, one or more mass storage devices) storing application programs 742 or data 744. Among them, the memory 732 and the storage medium 730 can be temporary storage or permanent storage. The program stored in the storage medium 730 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 722 can be configured to communicate with the storage medium 730 and execute a series of instruction operations in the storage medium 730 on the server 700.

[0101] The server 700 may also include one or more power supplies 726, one or more wired or wireless network interfaces 750, one or more input and output interfaces 758, one or more keyboards 756, and / or one or more operating systems 741, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0102] A non-temporary computer-readable storage medium, when the instructions in the above storage medium are executed by the processor of a device (smart terminal or server), the device can execute an input method, the above method includes: real-time detection of the touch point position during the user's handwriting input process; based on the touch point position and user-related information, determining the display point position, the display point position deviates from the touch point position; based on the display point position, presenting the touch point movement trajectory.

[0103] Optionally, the user-related information includes a preset position offset defined by the user; and determining the display point position based on the touch point position and the user-related information includes: determining the display point position based on the touch point position and the preset position offset.

[0104] Optionally, the user-related information includes real-time touch screen information; and determining the display point position based on the touch point position and the user-related information includes: determining a target position offset based on the real-time touch screen information; and determining the display point position based on the touch point position and the target position offset.

[0105] Optionally, the real-time touch screen information includes at least one of the following: touch screen mode, touch point pressure, and touch point area.

[0106] Optionally, the touch screen mode includes at least one of the following: left-hand touch screen and right-hand touch screen.

[0107] Optionally, determining the target position offset based on the real-time touch screen information includes: predicting the touch screen medium size of the user based on the contact pressure and the contact area; determining the direction of the display point position relative to the touch point position based on the touch screen mode; and determining the target position offset based on the touch screen medium size and the direction.

[0108] Optionally, the device is configured to execute one or more programs including instructions for performing the following operations by one or more processors: when a user's touch screen operation on a handwriting input panel is detected, monitoring the touch screen duration; when the touch screen duration reaches a first preset value, hiding or weakening the display of the operation buttons in the handwriting input panel.

[0109] Optionally, the device is configured to execute one or more programs including instructions for performing the following operations by one or more processors: when it is detected that the touch screen operation stops, monitoring the touch screen stop duration; when the touch screen stop duration reaches a second preset value, restoring the display of the hidden or weakened operation buttons.

[0110] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0111] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0112] The above is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

[0113] The above is a detailed introduction to an input method, a device and a device for input provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An input method, characterized in that: The method comprises: Real-time detection of the user's touch point position during handwriting input; Based on the touch point position and user-related information, a display point position is determined, and the display point position deviates from the touch point position; wherein, when the user-related information includes real-time touch screen information, the display point configuration is determined based on the touch point position and the target position offset; when the real-time touch screen information only includes the touch screen mode, the target position offset is determined based on the touch screen mode and a preset corresponding relationship, and the touch screen mode includes a left-hand touch screen, a right-hand touch screen, or a two-hand touch screen; in the corresponding relationship, the left-hand touch screen corresponds to a first position offset, the right-hand touch screen corresponds to a second position offset, and the two-hand touch screen corresponds to a third position offset, and the display point position calculated based on the first position offset is located at the upper right of the touch point position, the display point position calculated based on the second position offset is located at the upper left of the touch point position, and the display point position calculated based on the third position offset is located directly above the touch point position; Based on the display point position, presenting a contact point movement trajectory; When a user touches the handwriting input panel, the touch duration is acquired, and when the touch duration reaches a first preset value, the operation keys in the handwriting input panel are hidden or displayed in a weakened manner; wherein the weakened display refers to displaying with a preset transparency; When it is detected that the touch screen operation stops, the touch screen stop duration is obtained, and when the touch screen stop duration reaches a second preset value, the operation button that was hidden or weakened in display is restored to display.

2. The method according to claim 1, characterized in that The user-related information includes a preset position offset defined by the user; as well as, The determining the display point position based on the touch point position and user related information includes: Based on the touch point position and the preset position offset, a display point position is determined.

3. The method according to claim 1, characterized in that The user related information includes real-time touch screen information; as well as, The determining the display point position based on the touch point position and user related information includes: Determining a target position offset based on the real-time touch screen information; Based on the touch point position and the target position offset, a display point position is determined.

4. The method according to claim 3, characterized in that The real-time touch screen information includes: touch screen mode, touch point pressure and touch point area.

5. The method according to claim 4, characterized in that The step of determining the target position offset based on the real-time touch screen information includes: Predicting a touch screen medium size of the user based on the touch point pressure and the touch point area; Based on the touch screen mode, determining the direction of the display point position relative to the touch point position; A target position offset is determined based on the touch screen medium size and the direction.

6. An input device, characterized in that: The device comprises: An acquisition unit, configured to detect in real time the position of a touch point during a user's handwriting input process; a determination unit, configured to determine a display point position based on the touch point position and user-related information, the display point position deviating from the touch point position; wherein, when the user-related information includes real-time touch screen information, the display point configuration is determined based on the touch point position and a target position offset; when the real-time touch screen information only includes a touch screen mode, the target position offset is determined based on the touch screen mode and a preset corresponding relationship, the touch screen mode includes a left-hand touch screen, a right-hand touch screen, or a two-hand touch screen; in the corresponding relationship, the left-hand touch screen corresponds to a first position offset, the right-hand touch screen corresponds to a second position offset, and the two-hand touch screen corresponds to a third position offset, the display point position calculated based on the first position offset is located above the right side of the touch point position, the display point position calculated based on the second position offset is located above the left side of the touch point position, and the display point position calculated based on the third position offset is located directly above the touch point position; The presentation unit is configured to present a touch point movement trajectory based on the display point position; when a user's touch screen operation on the handwriting input panel is detected, the touch screen duration is obtained, and when the touch screen duration reaches a first preset value, the operation keys in the handwriting input panel are hidden or weakened; wherein the weakened display refers to displaying with a preset transparency; when it is detected that the touch screen operation stops, the touch screen stop duration is obtained, and when the touch screen stop duration reaches a second preset value, the operation keys that were hidden or weakened are restored to display.

7. A device for input, characterized in that The system comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: Real-time detection of the user's touch point position during handwriting input; Based on the touch point position and user-related information, a display point position is determined, and the display point position deviates from the touch point position; wherein, when the user-related information includes real-time touch screen information, the display point configuration is determined based on the touch point position and the target position offset; when the real-time touch screen information only includes the touch screen mode, the target position offset is determined based on the touch screen mode and a preset corresponding relationship, and the touch screen mode includes a left-hand touch screen, a right-hand touch screen, or a two-hand touch screen; in the corresponding relationship, the left-hand touch screen corresponds to a first position offset, the right-hand touch screen corresponds to a second position offset, and the two-hand touch screen corresponds to a third position offset, and the display point position calculated based on the first position offset is located at the upper right of the touch point position, the display point position calculated based on the second position offset is located at the upper left of the touch point position, and the display point position calculated based on the third position offset is located directly above the touch point position; Based on the display point position, presenting a contact point movement trajectory; When a user touches the handwriting input panel, the touch duration is acquired, and when the touch duration reaches a first preset value, the operation keys in the handwriting input panel are hidden or displayed in a weakened manner; wherein the weakened display refers to displaying with a preset transparency; When it is detected that the touch screen operation stops, the touch screen stop duration is obtained, and when the touch screen stop duration reaches a second preset value, the operation button that was hidden or weakened in display is restored to display.

8. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Method for assisting handwritten input on touch screen and electronic device thereof

    CN101630219A

  • Electronic equipment and touch input control method thereof

    CN103186329A

  • Selective pointer offset for touch-sensitive display device

    CN107810471A