Multifunctional stylus and interaction methods based on multifunctional stylus
By integrating a capacitive film and tilt detection component into a multi-functional stylus on a touch device, functional commands can be generated and the execution intensity adjusted. This solves the problem of physical buttons affecting aesthetics and user experience, achieving a balance between functional diversity and aesthetics, and improving the user experience.
Patent Information
- Application Number
- CN202510637812.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-16
- Publication Date
- 2026-11-17
AI Technical Summary
When expanding the functionality of existing touch devices, physical buttons affect the aesthetics and user experience, and their fixed position requires users to use specific grip postures.
It adopts a multi-functional stylus that integrates a capacitive diaphragm and a tilt detection component. It generates commands through the function operation on the capacitive diaphragm and adjusts the function execution intensity in real time by combining the pen body tilt angle data. The tilt detection component generates pen body tilt angle data, and the terminal adaptively adjusts the execution intensity of the function operation based on the tilt angle data.
It achieves a balance between functional diversity and aesthetics, enhances user intuitiveness and grip comfort, and improves the user experience.
Smart Images

Figure CN123114353A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of touch device technology, and in particular to a multi-functional stylus and an interaction method based on the multi-functional stylus. Background Technology
[0002] Touch devices can be used to provide input to terminal devices. For example, when the terminal includes a display screen, the touch device can be used to input commands to the terminal with the display screen. Users can select documents, draw, or write by clicking on the touch-sensitive display screen. However, the currently supported functions are limited. Related technologies will place physical buttons on the touch device and configure corresponding function commands for the physical buttons to expand the functionality of the touch device. However, using physical buttons will affect the appearance of the touch device, and the fixed position of the physical buttons requires the user's grip posture, resulting in a poor user experience. Summary of the Invention
[0003] The purpose of this invention is to at least solve one of the technical problems existing in the prior art, and to provide a multi-functional stylus and an interaction method based on the multi-functional stylus, which can improve the functional diversity of touch devices while ensuring aesthetics and improving the user experience.
[0004] In a first aspect, embodiments of the present invention provide a multi-functional stylus. The multi-functional stylus establishes a communication connection with a terminal. The multi-functional stylus includes a pen tip, a pen body, a tilt detection component, and a controller. The pen tip is used for touch interaction with the display screen of the terminal. The pen body is provided with a capacitive film. The tilt detection component is installed on the pen tip or the pen body and is used to generate pen body tilt angle data of the multi-functional stylus. The controller is installed inside the pen body and is connected to the capacitive film and the tilt detection component. The controller is used to generate a function command and send the pen body tilt angle data and the function command to the terminal when a function operation is triggered on the capacitive film, so that the terminal determines a function gain parameter based on the pen body tilt angle data and adjusts the execution intensity of the function command based on the function gain parameter.
[0005] In the multi-functional stylus provided in this embodiment of the invention, the pen tip is provided with a first transmitting electrode for transmitting a first frequency signal and a second transmitting electrode for transmitting a second frequency signal, so that the terminal determines a first signal position of the first frequency signal on the terminal's display screen and a second signal position of the second frequency signal on the terminal's display screen, and determines the pen body tilt angle data of the multi-functional stylus according to the distance between the first signal position and the second signal position.
[0006] In the multifunctional stylus provided in the embodiments of the present invention, the capacitive film is arranged around the pen body, and the capacitive film is divided into multiple recognition areas, wherein the function instructions generated by triggering the same function operation on different recognition areas are the same or different.
[0007] In the multi-functional stylus provided in this embodiment of the invention, the controller is used to generate a function command based on the number of triggered recognition areas along the axis of the pen body when a sliding operation is triggered on the capacitive film.
[0008] In the multi-functional stylus provided in this embodiment of the invention, the controller is used to, when a first functional operation is triggered on the capacitive film, use the touch point position of the first functional operation on the capacitive film as a partitioning reference point, and divide the capacitive film into multiple recognition areas according to the partitioning reference point.
[0009] The multifunctional stylus provided in this embodiment of the invention also includes a tactile feedback component disposed on the pen body. The tactile feedback component is connected to the controller. The controller is also used to control the tactile feedback component to provide tactile feedback according to the generated function command when a function operation is triggered on the capacitive film.
[0010] Secondly, embodiments of the present invention provide an interaction method based on a multi-functional stylus, applied to a terminal, wherein the multi-functional stylus establishes a communication connection with the terminal, and the multi-functional stylus is provided with a capacitive film; the method includes: Obtain the pen body tilt angle data of the multi-functional stylus; The functional gain parameters are determined based on the pen body tilt angle data; When a function command is received from the multi-functional stylus, the execution intensity is determined based on the function gain parameter, and the function command is executed according to the execution intensity. The function command is generated by the multi-functional stylus in response to a function operation triggered on the capacitive film.
[0011] In the interaction method of the multi-functional stylus provided in this embodiment of the invention, determining the functional gain parameter based on the pen body tilt angle data includes: Multiple preset tilt angle intervals are obtained, and different preset tilt angle intervals correspond to different candidate gain parameters; Based on the preset tilt angle range into which the pen body tilt angle data falls, the corresponding candidate gain parameter is determined as the functional gain parameter.
[0012] In the interaction method of the multi-functional stylus provided in this embodiment of the invention, the multi-functional stylus includes a pen tip and a pen body. The pen tip is provided with a first transmitting electrode and a second transmitting electrode. The pen body tilt angle data includes a first frequency signal transmitted by the first transmitting electrode and a second frequency signal transmitted by the second transmitting electrode. The step of determining the corresponding candidate gain parameter as a functional gain parameter based on the preset tilt angle range into which the pen body tilt angle data falls includes: Determine the first signal position of the first frequency signal on the display screen of the terminal, and the second signal position of the second frequency signal on the display screen of the terminal; The tilt angle of the multi-functional stylus is determined based on the distance between the first signal position and the second signal position. Based on the preset tilt angle range that the pen body tilt angle falls into, the corresponding candidate gain parameter is determined as the functional gain parameter.
[0013] In the interaction method of the multi-functional stylus provided in this embodiment of the invention, the step of receiving a function instruction from the multi-functional stylus, determining the execution intensity based on the function gain parameter, and executing the function instruction according to the execution intensity includes: When a function command is received from the multi-functional stylus, the target application currently running on the terminal is determined; Based on the target application and the function instructions, determine the target instruction operation; The execution intensity is determined based on the function gain parameter, and the target instruction operation is executed in the target application according to the execution intensity; Wherein, the target instruction operation of the terminal is the same or different when different target applications respond to the same function instruction.
[0014] The multi-functional stylus and interaction method based on the multi-functional stylus provided by the embodiments of the present invention have at least the following beneficial effects: The capacitive film integrated in the pen body of the multi-functional stylus can support a variety of touch function operations. The function operation triggered on the capacitive film of the pen body will generate a corresponding function command, and combined with the pen body tilt angle data generated in real time by the tilt angle detection component, it will be sent to the terminal. This allows the terminal to dynamically generate function gain parameters using the pen body tilt angle data, thereby adaptively adjusting the execution intensity of the function operation according to the tilt angle of the user holding the multi-functional stylus. This realizes an interaction method that adjusts the function operation effect by the pen body tilt angle, significantly improving the intuitiveness and convenience of operation. In addition, the layout of the capacitive film and the tilt angle detection component can take into account the functional practicality, aesthetics and pen body grip comfort, improving the user experience.
[0015] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the description, claims, and drawings. Attached Figure Description
[0016] The accompanying drawings are provided to further understand the technical solutions of the present invention and constitute a part of the specification. They are used together with the embodiments of the present invention to explain the technical solutions of the present invention, and do not constitute a limitation on the technical solutions of the present invention.
[0017] The present invention will be further described below with reference to the accompanying drawings and embodiments; Figure 1 This is a schematic diagram of the structure of the multifunctional stylus provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of the pen tip structure provided in an embodiment of the present invention; Figure 3 A schematic diagram illustrating the custom division of the recognition area of the capacitor film provided in an embodiment of the present invention; Figure 4 This is a schematic diagram illustrating the division of the identification area of the capacitor film provided in an embodiment of the present invention; Figure 5 This is a schematic diagram of tilt angle measurement for a multi-functional stylus provided in an embodiment of the present invention; Figure 6 A flowchart illustrating an interaction method based on a multi-functional stylus provided in an embodiment of the present invention. Detailed Implementation
[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.
[0019] It should be noted that in various specific embodiments of the present invention, when processing is required based on data related to the characteristics of the target object, such as target object attribute information or a set of attribute information, the permission or consent of the target object will be obtained first. Furthermore, the collection, use, and processing of this data will comply with relevant laws, regulations, and standards. The target object can be a user. In addition, when embodiments of the present invention need to obtain target object attribute information, separate permission or consent from the target object will be obtained through pop-ups or redirection to a confirmation page. Only after obtaining the target object's separate permission or consent will the necessary target object-related data for the normal operation of the embodiments of the present invention be obtained.
[0020] In this embodiment of the invention, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0021] It should be noted that the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.
[0022] Touch devices can be used to provide input to terminal devices. For example, when the terminal includes a display screen, the touch device can be used to input commands to the terminal with the display screen. Users can select documents, draw, or write by clicking on the touch-sensitive display screen. However, the currently supported functions are limited. Related technologies will place physical buttons on the touch device and configure corresponding function commands for the physical buttons to expand the functionality of the touch device. However, using physical buttons will affect the appearance of the touch device, and the fixed position of the physical buttons requires the user's grip posture, resulting in a poor user experience.
[0023] To address the aforementioned issues, this invention provides a multi-functional stylus and an interaction method based on it. The multi-functional stylus integrates a capacitive film within its body, supporting various touch-based functions. Functional operations triggered on the capacitive film generate corresponding function commands, which, combined with pen tilt angle data generated in real-time by a tilt angle detection component, are sent to the terminal. This allows the terminal to adaptively adjust the intensity of the function operation based on the user's grip angle, achieving an interaction method that adjusts the function operation effect by the pen tilt angle. This significantly improves operational intuitiveness, balances functional practicality, aesthetics, and pen grip comfort, and enhances the user experience.
[0024] In a first aspect, embodiments of the present invention provide a multi-functional stylus. The multi-functional stylus includes a pen tip, a pen body, a tilt detection component, and a controller. The multi-functional stylus can establish a communication connection with a terminal. It should be noted that the terminal may include at least one display screen. The terminal may refer to a single-display-screen device or a device with two or more displays screens that are foldable or statically configured. For example, the terminal may be a smartphone, tablet, computer, smartwatch, vehicle terminal, etc. When the pen tip of the multi-functional stylus is adjacent to the surface of the display screen, the multi-functional stylus can be used to provide touch input to the terminal. The pen tip of the multi-functional stylus may be made of a conductive material, supporting capacitive or electromagnetic touch signal transmission for touch interaction with the display screen of the terminal.
[0025] Reference Figure 1 , Figure 1 This is a schematic diagram of the structure of a multi-functional stylus provided in an embodiment of the present invention. The stylus body may be covered with a capacitive film. The controller can detect external interactions with the stylus body through the capacitive film, such as a user's finger. By interacting with the capacitive film on the stylus body, the user can trigger the functions of the multi-functional stylus and provide input to a terminal that has established a communication connection with the stylus. Specifically, the user can trigger single-click, double-click, or swipe operations on the capacitive film to control the functions of the terminal, such as playing and pausing audio and video, turning pages, adjusting volume, and other functions.
[0026] It is understandable that the capacitive diaphragm can be arranged around the pen body and located at the end of the pen body near the tip. Therefore, users can easily interact with the capacitive diaphragm while holding the multi-functional stylus. For example, by tapping or sliding one or more fingers along the capacitive diaphragm, the user can control the functions of the multi-functional stylus and / or the terminal. Specifically, when the user taps or slides on the capacitive diaphragm, the controller detects that the capacitive diaphragm has triggered a function operation, generates a function command corresponding to the triggered function operation, and sends it to the terminal. The function command can be used to instruct the terminal to perform a pre-set function action, such as opening the corresponding application, turning a page, adjusting the volume, or running a pre-set function. The defined instruction set allows the controller to generate a corresponding function instruction based on the user's pre-configured instructions for the multi-functional stylus when a specified function operation is triggered on the capacitive diaphragm. Therefore, the function instructions generated by the controller can be the same or different depending on the function operation triggered on the capacitive diaphragm. For example, if a single click is triggered on the capacitive diaphragm, the controller can generate an audio / video play / pause instruction; if a double click is triggered, the controller can generate an instruction to open a specified application; and if a swipe is triggered, the controller can generate a page-turning instruction.
[0027] It is understandable that the multi-functional stylus includes a tilt detection component, which is used to generate the pen body tilt angle data of the multi-functional stylus. The pen body tilt angle data can indicate the tilt angle of the multi-functional stylus. In other words, the pen body tilt angle data can refer to the data used by the terminal to calculate the tilt angle of the multi-functional stylus. The terminal can use the pen body tilt angle data to calculate the tilt angle of the multi-functional stylus. It is worth noting that the tilt detection component can be installed inside the pen tip or inside the pen body. For example, the tilt detection component can be multiple transmitting electrodes installed inside the pen tip, each transmitting electrode can emit different frequency signals, and the terminal can receive the corresponding frequency signals emitted by different electrodes and determine the pen body tilt angle based on the signal strength of these frequency signals; or, the tilt detection component can be an accelerometer, gyroscope or capacitive / resistive tilt sensor installed inside the pen body. For example, the inertial measurement unit integrates an accelerometer and a gyroscope and is installed inside the pen body as a tilt detection component. The data generated by the inertial measurement unit can be sent to the terminal, and the terminal can determine the pen body tilt angle of the multi-functional stylus based on the data generated by the inertial measurement unit.
[0028] It should be noted that, in addition to indicating the tilt angle of the multi-functional stylus, the pen tilt angle data can also be used to adjust the execution intensity of the corresponding functional action when the terminal responds to a function command. Execution intensity refers to the actual effective function parameter value when the terminal executes a function action. The meaning of execution intensity can be dynamically defined according to different types of functional actions. Specifically, after receiving the pen tilt angle data, the terminal can use the pen tilt angle data to determine the function gain parameter, and then use the function gain parameter to adjust the execution intensity of the functional action when the terminal responds to a function command. The function gain parameter can be a dynamic adjustment coefficient calculated based on the multi-functional stylus's pen tilt angle data through a preset tilt angle-gain mapping relationship. Execution intensity, function gain parameter, and the functional action executed by the terminal all correspond. For example, if the pen tilt angle data indicates that the larger the pen tilt angle, the larger the function gain parameter, then the greater the execution intensity of the functional action when the terminal responds to a function command. When the terminal executes a page-turning function, the execution intensity can refer to the page-turning speed, and the function gain parameter can be the corresponding speed gain coefficient. Therefore, the execution intensity can be dynamically adjusted through the function gain parameter. The page-turning speed of the entire terminal is affected by several factors. A larger pen tilt angle results in faster page-turning and a larger page-turning range for the same operation. Similarly, when zooming in or out, the execution intensity refers to the zoom ratio, and the function gain parameter can be the corresponding proportional gain coefficient. This allows for dynamic adjustment of the zoom ratio during zooming; a larger pen tilt angle results in a larger zoom ratio for the same operation. Likewise, when adjusting volume, the execution intensity refers to the volume adjustment amplitude, and the function gain parameter can be the corresponding amplitude gain coefficient. This allows for dynamic adjustment of the volume amplitude during volume control, resulting in a larger volume adjustment amplitude for the same operation. Therefore, different functions or commands correspond to independent gain mapping rules. Pen tilt angle data can serve as sensory input in different scenarios, enhancing interactivity. Users can achieve multi-functional interactions by changing their grip posture with the multi-functional stylus and the terminal, improving the user experience.
[0029] Reference Figure 2 , Figure 2This is a schematic diagram of the stylus tip structure provided in an embodiment of the present invention. It can be understood that the stylus includes a tip for contacting the surface of a terminal's display screen. For example, the stylus tip may include internal conductive electrodes, which can interact with the touch sensing electrodes of the terminal's display screen via capacitive coupling to achieve precise touch operation. The stylus tip may also include a first transmitting electrode and a second transmitting electrode. The first transmitting electrode is a conductive structure located at the stylus tip, used to emit electromagnetic signals of a specific frequency to form capacitive coupling with the sensing layer of the terminal's display screen. The second transmitting electrode is another conductive structure located at the stylus tip along with the first transmitting electrode, used to emit electromagnetic signals of another specific frequency. For example, the first transmitting electrode can emit a signal at a frequency of 485kHz, and the second transmitting electrode can emit a signal at a frequency of 471kHz. The first and second transmitting electrodes are arranged within the stylus tip along the axial direction of the stylus, i.e., the mounting positions of the second and first transmitting electrodes are... A distance D is left between the electrodes. For example, the first transmitting electrode can be installed near the tip of the pen, and the second transmitting electrode can be installed near the body of the pen. Therefore, when the pen body tilt angle changes, the projection distance d between the first and second transmitting electrodes on the terminal display screen will also change. Thus, the terminal can detect the pen body tilt angle at this time. Specifically, the first and second transmitting electrodes can emit signals of different frequencies. The terminal can analyze the projection positions of the two electrodes on the terminal display screen—that is, the corresponding first signal position and second signal position—based on the separation and positioning of the dual-frequency signals, and then calculate the pen body touch angle data. Figure 2 As shown, assuming the first transmitting electrode is located at point A of the pen tip (i.e., at the very tip of the pen), and the second transmitting electrode is located at point B of the pen tip, at the connection between the pen tip and the pen body, the first transmitting electrode emits a first frequency signal at a first frequency, and the second transmitting electrode emits a second frequency signal at a second frequency. The first and second frequencies are different. The frequency signals are coupled to the sensing layer of the terminal's display screen via the pen tip electrode, forming a local electric field change. Thus, the terminal can capture the signal through the sensing electrode array of the sensing layer, and then calculate the coordinates of the signal position corresponding to the frequency signal, i.e., the corresponding first signal position A' and second signal position B'. Then, based on the coordinate difference between the two signal positions, i.e., the projection distance d, the pen body tilt angle θ of the multi-functional stylus is calculated.
[0030] Understandably, the capacitive film can cover a portion of the pen body and be positioned around it. The film extends axially from the end of the pen body closest to the tip to the end furthest from the tip. In other words, a ring-shaped capacitive film covers the body of the multi-functional stylus, extending axially from the tip towards the end of the pen body. This fully covers the entire length of the user's hand grip area. The large recognition area is compatible with different grip postures when using the multi-functional stylus. Users do not need to memorize specific touch area positions; in a natural grip posture, finger contact with the capacitive film directly triggers the corresponding function, making it easy for users to use. For example, in a natural grip posture, the thumb can trigger a swipe to turn pages, and the index finger can trigger a double-tap to zoom or enlarge, helping to reduce the user's learning curve.
[0031] It's worth noting that the capacitive diaphragm can be divided into multiple recognition areas. When the same function operation is triggered in different recognition areas, the generated function commands can be the same or different. This is equivalent to dividing the capacitive diaphragm into multiple independent recognition areas, enabling the mapping of multiple gestures on the same stylus, such as swiping up and down, swiping in a circle, long press, single click, double click, etc. Each recognition area can be bound to different function commands, thereby realizing the multi-functional interaction of the stylus. For example, the capacitive diaphragm can be divided into three ring-shaped recognition areas, such as the first area near the tip, the second area adjacent to the first area, and the third area near the tail. When the user holds the stylus in a natural posture, a swipe operation can be triggered in the first area to turn pages, a swipe operation in the second area to adjust the volume, and a single click operation in the third area to play or pause. Therefore, the partitioned design can adapt to different scenario needs and avoid redundant and aesthetically unappealing physical buttons.
[0032] It should be noted that by dividing the design into multiple recognition areas, the touch behavior of different areas can be effectively identified, avoiding signal crosstalk when multiple fingers touch, and improving the accuracy of action recognition. For example, if multiple continuously triggered recognition areas are detected on the capacitive film, it can be assumed that the current multi-functional stylus is in a held state and will not trigger the generation of function commands.
[0033] Understandably, based on user habits, the partitions on the capacitive film can be customized, and the area on the capacitive film can be re-divided. Specifically, when a first functional operation is triggered on the capacitive film, the touch point of the first functional operation on the capacitive film will be used as the partition reference point, and then the capacitive film will be divided into multiple recognition areas according to the partition reference point. For example, the first functional operation can be a long press operation. The capacitive film of the multi-functional stylus does not have fixed partitions in its initial state. The user can trigger it by long pressing on the capacitive film. Then, the touch point of the long press operation on the capacitive film will be used to determine the ring-shaped dividing line, and the capacitive film will be divided into upper and lower recognition areas by the ring-shaped dividing line, referring to... Figure 3 , Figure 3 This is a schematic diagram illustrating the custom division of the recognition area of the capacitor film provided in this embodiment of the invention. The user triggers a first functional operation on the capacitor film, with the contact point position as shown... Figure 3 Point C, as shown, serves as the ring-shaped dividing line, dividing the capacitive film into two recognition areas: recognition area Sa and recognition area Sb. Furthermore, a first functional operation can be triggered on a recognition area after a partition on the capacitive film. For example, if recognition area Sa is further partitioned, the ring-shaped dividing line is determined by the contact point of this first functional operation on the capacitive film, and the current recognition area is divided using this ring-shaped dividing line. Therefore, the partition layout can be optimized according to the user's pen-holding posture, without being limited by the physical constraints of fixed partitions, thus improving the user experience and reducing operational fatigue.
[0034] Specifically, since the swiping operation requires the recognition of multiple consecutive recognition areas along multiple axes to be triggered, by customizing the capacitive membrane, the center point of the page-turning area can be customized for the page-turning operation of the swiping operation. That is, the user can customize the position of the center point of the page-turning area on the capacitive membrane, so that swiping down from the customized center point triggers the page-up, or swiping down from the customized center point triggers the page-down.
[0035] Reference Figure 4 , Figure 4This is a schematic diagram of the recognition area division of the capacitive film provided in this embodiment of the invention. Specifically, taking the capacitive film divided into 40 independent recognition areas as an example, the capacitive film is arranged in 8 rows axially and 5 columns radially. When multiple non-adjacent areas are continuously triggered for more than a first duration, it can be determined that the user is holding the pen and enters the anti-mistouch mode. At this time, the function operation triggered by these recognition areas can be blocked. If the trigger duration of a single recognition area is less than the second duration (e.g., 100ms) and there is no continuous signal in adjacent areas, it can be identified as a single click operation and a corresponding function instruction for a single click can be generated. If the same recognition area is triggered twice consecutively within a third duration (e.g., 20ms), it can be identified as a double click operation and a corresponding function instruction for a double click can be generated. If the two clicks involve different recognition areas, even if the time interval between the two clicks is less than the third duration, the function operation triggered this time can be blocked, or it can be determined as two independent single click operations. If three or more adjacent recognition areas are triggered consecutively in the same column, it can be identified as a sliding operation and a corresponding function instruction for sliding can be generated. Figure 4 As shown, the capacitive film is divided into 5 columns. If three adjacent recognition areas in the same column (S17, S18, S19, S20, S21, S22, S23, S24) are triggered consecutively, it can be recognized as a sliding operation.
[0036] In this system, after the multi-functional stylus enters the anti-mistouch mode, the displacement trajectory of the finger contact point can be analyzed by the changes in the recognition area on the capacitive film. The angular velocity provided by the inertial measurement unit inside the stylus can also be used to determine the rotation of the stylus body. If the recognition area is detected to be continuously triggered in the same row, i.e., horizontal sliding, and the deviation between the rotation speed and angular velocity calculated from the time interval between the horizontal sliding triggers of adjacent recognition areas is less than the speed deviation value, it can be considered that the stylus is not actively rotating, such as the user's hand sliding unconsciously, and the triggered function operation can be blocked. However, if the deviation between the rotation speed and angular velocity calculated from the time interval between the horizontal sliding triggers of adjacent recognition areas is greater than the speed deviation value, it can be considered that a horizontal sliding function operation or a single click operation has been triggered, and a corresponding function command is generated. For example, the function command triggered by the horizontal sliding operation can be used to instruct the terminal to perform screen rotation or viewing angle adjustment according to the sliding direction.
[0037] It's understandable that when a swipe operation is triggered on the capacitive stylus, a corresponding function command is generated based on the number of triggered recognition areas along the pen's axis. Different numbers of triggers result in different function commands, meaning different swipe amplitudes on the stylus will trigger different operations. For different gripping postures of the multi-functional stylus, the triggered trajectory when a swipe operation is triggered on the capacitive stylus will also differ. Specifically, the number of triggered recognition areas along the pen's axis can refer to the number of recognition areas on the same axis of the pen, or the number of recognition areas on different axes of the pen, such as... Figure 4 As shown, the recognition areas on the same axis can refer to the recognition areas in the same column. For example, the eight recognition areas S17, S18, S19, S20, S21, S22, S23, and S24 in the same column are recognition areas on the same axis. When recognition areas S17, S18, and S19 are triggered consecutively, it can be considered that a sliding operation is triggered. If the number of recognition areas triggered is 3, a first function command for the sliding operation can be generated. The first function command for the sliding operation can be used to instruct the terminal to perform a small page flip on the current display page, such as flipping one page. When recognition areas S19, S20, S21, S22, and S23 are triggered consecutively, if the number of recognition areas triggered by the sliding operation is 5, a second function command for the sliding operation can be generated. The second function command for the sliding operation can be used to instruct the terminal to perform a large page flip on the current display page, such as flipping three pages. The function actions and action intensity triggered by the first and second function commands for the sliding operation on the terminal can be customized according to user needs. Recognition areas not on the same axis can refer to recognition areas in different columns along the axis. For example, recognition areas S17, S18, and S11 are triggered consecutively. Although recognition areas S17, S18, and S11 are not in the same column, they are at different heights along the pen body axis and are continuous in height. Therefore, they can be considered to trigger a sliding operation. Furthermore, based on the number of recognition areas triggered along the axis, corresponding function commands can be generated, thereby breaking through the single-column operation limitation, realizing cross-column sliding, accommodating different user grip postures, and improving the user experience.
[0038] Understandably, a haptic feedback component is also provided on the pen body. The haptic feedback component is connected to the controller and is used to provide corresponding haptic feedback when the function operation is triggered on the capacitive diaphragm. The haptic feedback provided by the haptic feedback component is different when different functions are triggered. For example, when the single-click function is triggered, the haptic feedback component can provide a single short pulse haptic feedback, while when the double-click function is triggered, the haptic feedback component will provide a double pulse haptic feedback. When the sliding operation is triggered, the haptic feedback component can provide continuous vibration haptic feedback with the vibration frequency increasing linearly with the sliding speed. Furthermore, since the tilt angle of the multi-functional stylus affects the execution intensity of corresponding functions on the terminal, the tilt angle range of the multi-functional stylus can be divided into intervals, and the execution intensity of the terminal's corresponding functions can be divided accordingly. When the tilt angle of the multi-functional stylus jumps from one interval to another, it means that the execution intensity of the terminal's corresponding function also changes. The haptic feedback component can provide corresponding haptic feedback to the user in response to the change in the tilt angle of the multi-functional stylus, prompting the user that the execution intensity of the terminal has been adjusted. Moreover, the intensity of the haptic feedback can be synchronized with the execution intensity of the terminal. For example, if the tilt angle of the multi-functional stylus is larger and the execution intensity of the terminal is greater, then the haptic feedback intensity provided by the haptic feedback component will also be greater. Through stepped haptic feedback, the interval change information can be clearly conveyed to the user, enhancing the interaction with the user.
[0039] Reference Figure 5 , Figure 5This is a schematic diagram of tilt angle measurement for a multi-functional stylus provided in an embodiment of the present invention. The capacitive film on the multi-functional stylus is connected to a controller, such as a touch chip. The touch chip can sense the recognition area triggered on the capacitive film through the capacitive film, and then analyze the triggering state of each recognition area on the capacitive film to determine whether the function operation triggered on the capacitive film is a single click, double click, or swipe. Then, the touch chip generates a corresponding function command for the detected function operation and feeds the function command back to the Bluetooth module, which then sends the function command to the terminal. In addition, besides providing tactile feedback in response to the function operation triggered on the capacitive film, the tactile feedback component can also receive control commands from the terminal via the Bluetooth module and provide tactile feedback. The terminal will send control commands to the tactile feedback component of the multi-functional stylus according to the current application scenario. For example, when writing on drawing software displayed on the terminal screen using the multi-functional stylus, the terminal will send corresponding feedback information, i.e., control commands, to the multi-functional stylus after recognizing the writing operation of the multi-functional stylus, thereby controlling the tactile feedback component to provide vibration as tactile feedback to simulate the vibration of pen strokes rubbing against paper, thus improving the interaction between the multi-functional stylus and the user. It is worth noting that the pen body tilt angle data detected by the tilt angle detection component is fed back to the terminal in real time via Bluetooth module, so that the terminal can obtain the pen body tilt angle data of the multi-functional stylus in real time and determine the pen body tilt angle of the multi-functional stylus.
[0040] Figure 6 This is a flowchart illustrating an interaction method based on a multi-functional stylus provided in an embodiment of the present invention. This interaction method can be executed by a terminal. (Refer to...) Figure 6 The interaction method includes, but is not limited to, steps 110 to 130.
[0041] Step 110: Obtain the pen body tilt angle data of the multi-functional stylus; Step 120: Determine the functional gain parameters based on the pen body tilt angle data; Step 130: When a function command from the multi-function stylus is received, the execution intensity is determined based on the function gain parameter, and the function command is executed according to the execution intensity.
[0042] Understandably, the terminal may have a display screen with a sensing layer. This sensing layer can capacitively couple with electrodes within the multi-functional stylus, allowing the terminal to interact with it. The terminal establishes a communication connection with the multi-functional stylus, acquiring its tilt angle data. This tilt angle data indicates the stylus's tilt angle relative to the display screen, measured in real-time by a tilt detection component within the stylus. This quantifies the stylus's posture, enabling the terminal to determine functional gain parameters based on the stylus's posture and adjust the intensity of its actions.
[0043] The pen tilt angle data can be based on the terminal display screen surface as the reference plane, with a 90° tilt angle when the pen tip is perpendicular to the screen. When the tilt angle detection component is an accelerometer, gyroscope, or other sensors, the tilt angle detection component can directly send the pen tilt angle data generated by these sensors to the terminal. The pen tilt angle data is used to determine the user's pen grip posture. Different pen grip postures affect the gesture box. For example, in swiping operations, a larger pen tilt angle results in a shorter gesture distance, which is not conducive to the smoothness of swiping. Therefore, the pen tilt angle data is used to adjust the interaction intensity between the multi-functional stylus and the terminal.
[0044] Specifically, when the tilt detection component consists of two transmitting electrodes located at the pen tip, the pen tilt angle data can refer to signals of different frequencies emitted by the two transmitting electrodes, namely, a first frequency signal emitted by the first transmitting electrode and a second frequency signal emitted by the second transmitting electrode. Since the signal received by the terminal is a mixed signal, the terminal can first perform a Fast Fourier Transform on the received mixed signal to separate the frequency components corresponding to the first and second frequency signals. Then, it can demodulate each frequency component, calculate the corresponding amplitude and phase information, and reconstruct the first and second frequency signals. Finally, by detecting the signal strength of each frequency signal on the sensing electrode of the display screen, the display of the two signals on the display screen can be determined. The coordinate points are the first signal position of the first frequency signal and the second signal position of the second frequency signal. Then, based on the coordinate points of the two signals, the Euclidean distance between the two signal positions is calculated. The distance between the two signal positions is different for the multi-functional stylus under different tilt angles. As the tilt angle of the multi-functional stylus increases, the distance between the two signal positions decreases. When the stylus body is perpendicular to the display screen, the tilt angle of the stylus body is the largest, which is 90°. When the stylus body is parallel to the display screen, the tilt angle of the stylus body is the smallest, which is 0°. Therefore, the tilt angle of the multi-functional stylus body can be determined by the distance between the signal positions of the two signals.
[0045] It's understandable that the function gain parameter refers to a coefficient used to correct the execution intensity when the terminal performs a function action. The function gain parameter is a dynamically adjusted coefficient calculated by the terminal based on the pen's tilt angle data through a preset tilt angle-gain mapping relationship. The execution intensity, i.e., the function gain parameter, corresponds one-to-one with the function action performed by the terminal. Specifically, the larger the pen tilt angle, the greater the function gain parameter can be, thus increasing the execution intensity of the function action when responding to function commands. For example, when the terminal performs a page-turning function, the execution intensity can be reflected in the page-turning speed. The function gain parameter corresponds to the speed gain coefficient. By adjusting the function gain coefficient, the page-turning speed of the terminal can be dynamically changed; the larger the pen tilt angle, the faster the page-turning speed. The greater the amplitude, the stronger the effect. Similarly, when the terminal performs a screen zoom function, the execution intensity can be reflected as the screen zoom ratio, and the function gain parameter corresponds to the proportional gain coefficient. By adjusting the function gain parameter, the zoom ratio of the terminal when performing screen zoom will also increase accordingly. When the terminal performs a volume adjustment function, the execution intensity can be reflected as the volume adjustment amplitude, and the function gain parameter corresponds to the amplitude gain coefficient. By adjusting the function gain parameter, the volume amplitude of the terminal when performing volume adjustment will also increase accordingly. Therefore, different function actions or function commands correspond to independent gain mapping rules. The pen body tilt angle data can be used as a sensory input in different scenarios to enhance the interaction capability. It is equivalent to the user being able to change the grip posture and interact with the multi-functional stylus and the terminal to achieve multi-functional interaction, thereby improving the user experience.
[0046] Among them, there is a mapping relationship between the pen body tilt angle data and the function gain parameter. The pen body tilt angle data can be positively correlated with the function gain parameter. The larger the tilt angle corresponding to the pen body tilt angle data, the larger the function gain coefficient. Alternatively, since the tilt angle of the multi-functional stylus is usually normally distributed within the tilt angle range when it is naturally held, the function gain coefficient first decreases and then increases as the pen body tilt angle data increases. When the user holds the stylus naturally, the function gain coefficient is small, avoiding user misoperation that leads to excessive terminal response, which is consistent with the user's actual usage.
[0047] Specifically, by constructing a tilt-gain mapping relationship between pen tilt angle data and functional gain parameters through mathematical functions, and then mapping the pen tilt angle data to functional gain parameters through mathematical functions, stepless continuous adjustment can be achieved, avoiding the inconsistency of operation caused by interval jumps.
[0048] Specifically, the tilt angle range of the multi-functional stylus, from 0° to 90°, can be divided into multiple preset tilt angle intervals. Each preset tilt angle interval corresponds to a different candidate gain parameter. For example, the tilt angle range of 0° to 90° can be evenly divided into three preset tilt angle intervals: a low tilt angle interval (0°≤θ<30°), with a corresponding gain parameter k1 of 1; a medium tilt angle interval (30°≤θ<60°), with a corresponding gain parameter k2 of 1+0.02(θ-30°); and a high tilt angle interval (60°≤θ≤90°), with a corresponding gain parameter k3 of 2. The candidate gain parameter corresponding to the medium tilt angle interval can be dynamically changed according to the actual tilt angle of the stylus. Furthermore, as the tilt angle increases, the candidate gain parameter also increases accordingly. The preset tilt angle interval can be determined using the stylus tilt angle data or the stylus tilt angle itself, and the corresponding candidate gain coefficient within that interval can be selected as the functional gain parameter. In addition to dividing the tilt angle range evenly, it can also divide the tilt angle range into multiple non-linear intervals, which can be adapted to scenarios that require precise operation or scenarios that require rapid adjustment.
[0049] It is understandable that upon receiving a function command from the multi-function stylus, the terminal executes the command and adjusts the intensity of the corresponding function action based on the function gain parameter. The function commands sent by the multi-function stylus are generated through function operations triggered on the capacitive diaphragm. Different function operations triggered on the diaphragm generate different function commands, and different function commands correspond to different needs. Therefore, the terminal executes different function actions when responding to different function commands. For example, a function command generated by a swipe operation instructs the terminal to perform a page-turning action; similarly, a function command generated by a double-tap operation instructs the terminal to perform a play / pause action; and similarly, a double-tap operation instructs the terminal to perform a pause / play action.
[0050] When the terminal executes a corresponding function command, it dynamically adjusts the operation effect by combining the function command and the function gain parameter. Specifically, without the influence of the function gain parameter, the terminal executes the function command according to a pre-set base intensity, such as turning a page or reducing the volume by 5 decibels. After determining the function gain parameter based on the pen tilt angle data, the function gain parameter is used to adjust the execution intensity of the terminal when executing the function command. Specifically, the function gain parameter adjusts the base intensity. The function gain parameter acts as a gain coefficient, and the base intensity is multiplied by the function gain parameter to obtain the actual execution intensity. The function command is then executed according to the adjusted execution intensity. For example, assuming the current function command is to turn a page, the base intensity is one page per second, and the current pen tilt angle is 55°, the actual execution intensity is then adjusted. The defined function gain coefficient is 1.5. Based on the function gain parameter, the execution intensity is determined to be three pages every two seconds. Therefore, when the user slides on the capacitive film of the multi-functional stylus to trigger multiple consecutive recognition areas along the axis, the multi-functional stylus recognizes the sliding operation as a triggered sliding operation and generates a corresponding function command. At the same time, the haptic feedback component provides haptic feedback for the sliding operation. The intensity of the haptic feedback provided can also be dynamically adjusted according to the pen body tilt angle data. The terminal obtains the pen body tilt angle data of the multi-functional stylus and determines the function gain coefficient based on the pen body tilt angle data. At the same time, after obtaining the function command sent by the multi-functional stylus, the terminal adjusts the execution intensity when executing the function command according to the function gain coefficient. Specifically, the terminal responds to the function command and executes the page-turning action at an intensity of three pages every two seconds.
[0051] Understandably, when responding to function commands, the terminal dynamically adjusts the command operation to be executed based on the current operating scenario. Specifically, after receiving a function command from the multi-functional stylus, the terminal detects the target application currently running on the terminal, then maps the function command to the corresponding command operation in the target application, thus determining the target command operation. Based on the function gain parameter, the terminal then adjusts the execution intensity of the target command operation within the target application. The target application refers to the main application currently running in the foreground, or the window or application the user is currently interacting with. For example, the application the user last clicked or operated on is marked as the target application. Target applications can be categorized in several ways, including photography, office, reading, long video, short video, browser, and shopping applications. The target command operation refers to the mapping of the function command received by the multi-functional stylus to a specific function operation that can be executed within the current target application. The defined command operations for the same function command can be the same or different in different target applications. The terminal achieves flexible adaptation through a dynamic mapping table, which indicates the function operation bound to each function command on different target applications. Taking the function command generated by double-clicking as an example, when there is no application running in the foreground of the terminal, i.e., no target application, the terminal responds to the function command and can perform predetermined functions such as bringing up the menu bar, search interface, notification center, and recently used programs. When running a camera-type target application, the terminal responds to the function command and can take a picture. When running office, reading, shopping, and browser-type target applications, the terminal responds to the function command and can perform operations such as page turning, copying, pasting, and cutting. When running long video and short video target applications, the terminal responds to the function command and can perform operations such as switching to the next video or switching to the next audio. Alternatively, when running a specified target application, the terminal responds to the function command and can perform operations such as screenshotting, quick memo, recording, volume adjustment, and brightness adjustment.
[0052] It is understood that although the steps in the above flowcharts are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated in this embodiment, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the above flowcharts may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps.
[0053] This invention also provides a computer-readable storage medium for storing a computer program for executing the interaction methods based on the multi-functional stylus of the foregoing embodiments.
[0054] This invention also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the aforementioned interaction method based on a multi-functional stylus.
[0055] The terms "first," "second," "third," "fourth," etc. (if present) in the specification and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate to describe embodiments of the invention, for example, those that can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatuses.
[0056] It should be understood that in this invention, "at least one (item)" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.
[0057] It should be understood that in the description of the embodiments of the present invention, multiple (or more) means two or more, greater than, less than, and exceeding are understood to exclude the number itself, while above, below, and within are understood to include the number itself.
[0058] In the embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.
[0059] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0060] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0061] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0062] It should also be understood that the various implementation methods provided in the embodiments of the present invention can be combined arbitrarily to achieve different technical effects. The above provides a detailed description of the preferred embodiments of the present invention. However, the present invention is not limited to the above embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present invention. All such equivalent modifications or substitutions are included within the scope defined by the claims of the present invention.
Claims
1. A multi-functional stylus, characterized in that, The multi-functional stylus establishes a communication connection with the terminal, and the multi-functional stylus includes: The pen tip is used for touch interaction with the terminal's display screen; The pen body is equipped with a capacitor film; An angle detection component is installed on the pen tip or the pen body, and the angle detection component is used to generate pen body angle data of the multi-functional stylus; A controller is installed inside the pen body. The controller is connected to the capacitive diaphragm and the tilt detection component. When a function operation is triggered on the capacitive diaphragm, the controller generates a function command and sends the pen body tilt data and the function command to the terminal, so that the terminal determines the function gain parameter based on the pen body tilt data and adjusts the execution intensity of the function command based on the function gain parameter.
2. The multi-functional stylus according to claim 1, characterized in that, The pen tip is provided with a first transmitting electrode for transmitting a first frequency signal and a second transmitting electrode for transmitting a second frequency signal, so that the terminal determines a first signal position of the first frequency signal on the terminal's display screen and a second signal position of the second frequency signal on the terminal's display screen, and determines the pen body tilt angle data of the multi-functional stylus based on the distance between the first signal position and the second signal position.
3. The multifunctional stylus according to claim 1, characterized in that, The capacitive film is arranged around the pen body, and the capacitive film is divided into multiple recognition areas. The function commands generated by triggering the same function operation on different recognition areas may be the same or different.
4. The multifunctional stylus according to claim 3, characterized in that, The controller is used to generate a function command based on the number of the triggered recognition areas along the pen body axis when a sliding operation is triggered on the capacitive film.
5. The multifunctional stylus according to claim 3, characterized in that, The controller is used to, when a first functional operation is triggered on the capacitor film, use the contact position of the first functional operation on the capacitor film as a partitioning reference point, and divide the capacitor film into multiple recognition areas according to the partitioning reference point.
6. The multi-functional stylus according to claim 1, characterized in that, It also includes a tactile feedback component disposed on the pen body, the tactile feedback component being connected to the controller, the controller being further configured to control the tactile feedback component to provide tactile feedback according to the generated function command when a function operation is triggered on the capacitive diaphragm.
7. An interaction method based on a multi-functional stylus, applied to a terminal, characterized in that, The multi-functional stylus establishes a communication connection with the terminal, and the multi-functional stylus is equipped with a capacitive film. The method includes: Obtain the pen body tilt angle data of the multi-functional stylus; The functional gain parameters are determined based on the pen body tilt angle data; When a function command is received from the multi-functional stylus, the execution intensity is determined based on the function gain parameter, and the function command is executed according to the execution intensity. The function command is generated by the multi-functional stylus in response to a function operation triggered on the capacitive film.
8. The method according to claim 7, characterized in that, The step of determining the functional gain parameter based on the pen body tilt angle data includes: Multiple preset tilt angle intervals are obtained, and different preset tilt angle intervals correspond to different candidate gain parameters; Based on the preset tilt angle range into which the pen body tilt angle data falls, the corresponding candidate gain parameter is determined as the functional gain parameter.
9. The method according to claim 8, characterized in that, The multi-functional stylus includes a pen tip and a pen body. The pen tip is provided with a first transmitting electrode and a second transmitting electrode. The pen body tilt angle data includes a first frequency signal transmitted by the first transmitting electrode and a second frequency signal transmitted by the second transmitting electrode. The step of determining the corresponding candidate gain parameter as a functional gain parameter based on the preset tilt angle range into which the pen body tilt angle data falls includes: Determine the first signal position of the first frequency signal on the display screen of the terminal, and the second signal position of the second frequency signal on the display screen of the terminal; The tilt angle of the multi-functional stylus is determined based on the distance between the first signal position and the second signal position. Based on the preset tilt angle range that the pen body tilt angle falls into, the corresponding candidate gain parameter is determined as the functional gain parameter.
10. The method according to claim 7, characterized in that, The step of receiving a function command from the multi-functional stylus, determining the execution intensity based on the function gain parameter, and executing the function command according to the execution intensity includes: When a function command is received from the multi-functional stylus, the target application currently running on the terminal is determined; Based on the target application and the function instructions, determine the target instruction operation; The execution intensity is determined based on the function gain parameter, and the target instruction operation is executed in the target application according to the execution intensity; Wherein, the target instruction operation of the terminal is the same or different when different target applications respond to the same function instruction.
