Directionless handheld touch input device and its direction-adaptive method
Patent Information
- Application Number
- CN202610989826.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-03
- Publication Date
- 2026-09-25
AI Technical Summary
[0005]本发明的目的在于提供一种无方向手持触控输入设备及其方向自适应方法,以解决设备旋转、翻面、左右手切换及非视线关注场景下,原始触控坐标与目标输出坐标之间映射关系不稳定的问题
1. 通过姿态信息和表面交互状态信息联合确定当前有效输入方向状态,降低设备旋转、翻面或握持切换时的输入方向误判概率。
Smart Images

Figure CN122816480A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of human-computer interaction technology, specifically to a non-directional handheld touch input device and its orientation adaptive method. Background Technology
[0002] Existing input devices mainly include traditional mice, laptop touchpads, stand-alone touchpads, air mice, remote controls, and solutions that use mobile phones or tablets as touch input terminals. While these solutions are suitable for certain scenarios, they still have shortcomings in scenarios where the device can be held in any direction, without needing to distinguish directions, and can be operated without eye contact.
[0003] Traditional mice rely on a fixed bottom orientation and flat support, requiring a clear sense of device orientation and support conditions, limiting their use in scenarios such as lying down, moving, screen projection, and remote control. Traditional touchpads are tied to the orientation of a fixed device surface; when the device is rotated, flipped, inverted, or held by different hands, the user's subjective operating direction can easily differ from the system's recognized direction. Air mice primarily rely on inertial devices to control the pointer; while they can sense rotation and movement, they struggle to determine the primary input surface, grip surface, left / right hand position, and flipping state based on surface contact status, leading to misjudgments in complex holding scenarios. Solutions using smartphones or tablets as touchpads typically default to a fixed screen orientation and a single operating surface, hindering users from using them immediately upon picking them up and making it difficult to accommodate dual-sided interaction, blind operation, and lightweight text input. Furthermore, existing input devices generally struggle to stably integrate pointer control and text input within the same handheld terminal, especially lacking mature solutions for screenless, dual-sided interaction, curved surfaces, or non-line-of-sight scenarios. Existing technologies such as CN104049759A, which combine touchscreen and behavior perception for instruction input and protection, while incorporating posture and grip perception, aim to determine whether input is disabled, but do not address the issue of inconsistency between the user's subjective operation direction and the system's recognition direction.
[0004] Existing technologies typically use a fixed device orientation, display orientation, or a single input surface as the basis for input interpretation, making it difficult to stably determine the mapping relationship between the original touch coordinates and the target output coordinates when the device is rotated, flipped, or its grip is changed. Therefore, there is a need for a handheld touch input solution that can stably determine the current directional state used to interpret touch input without pre-defining the device orientation, and map the original touch coordinates to the target output coordinate system. Summary of the Invention
[0005] The purpose of this invention is to provide a non-directional handheld touch input device and its orientation adaptive method to solve the problem of unstable mapping relationship between original touch coordinates and target output coordinates in scenarios such as device rotation, flipping, left and right hand switching, and non-line-of-sight focus.
[0006] To achieve the above objectives, the present invention provides a non-directional handheld touch input device, including a surface interaction acquisition unit, a posture sensing unit, a control processing unit, and an output unit.
[0007] The surface interaction acquisition unit is used to acquire surface interaction state information of at least one outer surface of the device. The surface interaction state information may include one or more of the following: contact area, contact center of gravity, contact duration, contact motion intensity, contact distribution, and edge contact offset.
[0008] The attitude sensing unit is used to collect the attitude information of the device. The attitude information may consist of acceleration information, angular velocity information, or other information that can reflect the spatial attitude state of the device.
[0009] The control processing unit generates a basic orientation candidate state based on posture information, determines the input master surface and / or the grip master surface based on surface interaction state information, and modifies the basic orientation candidate state based on at least one of the input master surface, grip master surface, flip state, left / right hand state, or grip mirror state to obtain the orientation candidate state. The control processing unit also determines the current valid input orientation state based on the stability confirmation result of the orientation candidate state, and performs adaptive orientation mapping on the original touch coordinates based on the current valid input orientation state to obtain the target input coordinates.
[0010] The current valid input orientation state is an orientation state determined by the control processing unit based on at least two of the following: attitude candidate state, input main face, grip main face, flip state, left and right hand states, and current interaction mode. It is used to map the original touch coordinates to the target output coordinate system. This state is not a direct expression of the device's physical orientation.
[0011] The output unit is used to output pointer control signals and / or text input signals based on the target input coordinates.
[0012] The present invention also provides a direction adaptation method, the method comprising: acquiring posture information; acquiring surface interaction state information; generating basic direction candidate states; determining the input master surface and / or the gripping master surface; correcting the basic direction candidate states; determining the current valid input direction state based on the stability confirmation result; performing direction adaptation mapping; and outputting pointer control signals and / or text input signals.
[0013] Compared with the prior art, the present invention has at least the following technical effects: 1. By jointly determining the current valid input direction state through posture information and surface interaction state information, the probability of input direction misjudgment is reduced when the device is rotated, flipped, or the grip is switched.
[0014] 2. By determining the input main surface and / or the gripping main surface, the surface used for active input is distinguished from the surface used for gripping contact, thereby improving the stability of orientation state determination in two-sided or multi-sided interaction scenarios.
[0015] 3. Through rotation transformation, mirror correction, and optional geometric compensation, the original touch coordinates are converted into target input coordinates, so that touch inputs from different device orientations can correspond to the same target output coordinate system.
[0016] 4. By employing stability verification, state locking, and hysteresis switching mechanisms, jitter and erroneous switching of orientation state under boundary attitude or motion disturbances are reduced.
[0017] 5. By serving both pointer mode and text mode with the same currently valid input direction state, pointer control and text input can share a unified direction interpretation framework. Attached Figure Description
[0018] Figure 1 This is a schematic diagram of the overall structure of the device of the present invention; Figure 2 This is a schematic diagram showing the configuration of the first and second surfaces of the device of the present invention; Figure 3 This is a flowchart of the posture recognition and orientation determination process of the present invention; Figure 4 This is a schematic diagram of the dual-sided interactive linkage judgment input surface and the gripping surface of the present invention; Figure 5 This is a schematic diagram of the coordinate mapping relationship of the present invention; Figure 6 This is a flowchart illustrating the switching between pointer mode and text mode in this invention. Figure 7 This is a schematic diagram of an embodiment of the present invention with a screen; Figure 8 This is a schematic diagram of a screenless implementation of the present invention; Figure 9 This is a schematic diagram of a dual-sided full-screen embodiment of the present invention; Figure 10 This is a schematic diagram of an embodiment of the present invention with a curved or ergonomic shape. Detailed Implementation
[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0020] Please see Figure 1-10The present invention provides the following technical solutions: Example 1: Basic Structure of the Equipment This embodiment provides a directional handheld touch input device. (Refer to...) Figure 1 The device includes: a surface interaction acquisition unit, an attitude sensing unit, a control processing unit, an output unit, a feedback unit, and an optional display unit.
[0021] The surface interaction acquisition unit is used to collect interaction status information of one or more external surfaces of the device. In this embodiment, the surface interaction acquisition unit adopts a capacitive touch array, which can collect interaction features such as contact area, contact center of gravity, edge contact offset, contact duration, and touch point movement trajectory. In other embodiments, the surface interaction acquisition unit may also adopt a pressure sensing array, an edge sensing structure, or a touch display integrated structure.
[0022] The attitude sensing unit is used to collect the attitude information of the device. In this embodiment, the attitude sensing unit includes an accelerometer and a gyroscope, and can output acceleration information A=(ax, ay, az) and angular velocity information G=(gx, gy, gz). In other embodiments, the attitude sensing unit can use different combinations of inertial devices, as long as it can obtain information reflecting the spatial state of the device.
[0023] The control processing unit is the core processing module, used to jointly determine the current valid input direction state based on posture information and surface interaction state information, and to perform adaptive direction mapping on the original touch coordinates according to this valid input direction state, generating input commands consistent with the user's subjective operation direction. The output unit is used to output pointer control signals and / or text input signals. The feedback unit is used to output haptic feedback and / or audio feedback. An optional display unit is used to display the input interface, candidate words, or status information.
[0024] Example 2: Mechanism for Generating Valid Input Direction States This embodiment describes in detail the specific process by which the control processing unit generates a valid input direction state. (Refer to...) Figure 3 The process includes the following three levels of steps.
[0025] Level 1: Generation of Basic Directions The attitude sensing unit outputs acceleration information A=(ax, ay, az) and angular velocity information G=(gx, gy, gz). The control processing unit obtains the smoothed attitude parameters through a filtering algorithm. pitch = f1(ax, ay, az) roll = f2(ax, ay, az) yaw = yaw(t-1) + gz·dt Then, the system discretizes the posture into several basic orientation candidate states according to the threshold, such as: B0 (forward state), B1 (rotation 90 degrees state), B2 (rotation 180 degrees state), B3 (rotation 270 degrees state), and B4 (flipping candidate state).
[0026] Level Two: Main Face and Grip Correction Based on the basic direction candidate states, the system further performs corrections according to the surface interaction state information. This correction includes at least the following judgments: which surface is more likely to be the input main surface, which surface is more likely to be the holding main surface, whether there is a left-right hand switching, whether a flip has occurred, and whether it is in a mirror state caused by a large area of holding.
[0027] In double-sided devices, the following features are preferred for joint judgment: FrontArea: Total contact area of the front surface BackArea: Total contact area of the rear surface FrontCentroid: Center of gravity of the front surface BackCentroid: Rear surface contact center of gravity FrontMotion: Movement intensity of the front surface contact points BackMotion: Movement intensity of the rear surface contact points EdgeBiasFront: Front surface edge contact bias EdgeBiasBack: Rear surface edge contact bias If one surface satisfies "large area, long duration, low motion intensity" while another surface satisfies "small area, short duration, high motion intensity", then the former is determined to be the holding surface and the latter is determined to be the input surface.
[0028] Level 3: Stability Confirmation and State Locking The control processing unit can calculate the directional stability fraction Pdir: Pdir = w1·Sposture + w2·Ssurface + w3·Sduration - w4·Sdisturbance Here, Sposture represents the degree of attitude stability, Ssurface represents the surface interaction consistency, Sduration represents the duration of the candidate state, and Sdisturbance represents the degree of motion disturbance. These components can be normalized to the range of 0 to 1. The degree of attitude stability can be determined by the change in attitude angle within a preset time window; the surface interaction consistency can be determined by the proportion of the input master surface and / or the gripping master surface remaining unchanged within a continuous sampling period; the degree of motion disturbance can be determined by the change in angular velocity or acceleration. When Pdir is greater than the entry threshold and remains so for a first duration, the control processing unit confirms the new current valid input direction state.
[0029] During preset operation phases such as dragging, scrolling, continuous text input, or mode switching confirmation, the control processing unit locks the current valid input direction state. If it detects that the device experiences short-term weightlessness, all surfaces are released, the relationship between the two main surfaces is reversed, or the angular velocity exceeds the disturbance threshold, the control processing unit can pause direction updates or enter a reinitialization state.
[0030] Example 3: Specific Links for Direction Adaptive Mapping This embodiment details the specific transformation process from the original touch coordinates to the target input coordinates. (Refer to...) Figure 5 The mapping link includes the following steps.
[0031] Step 1: Input coordinate normalization Assuming the original coordinates of the touch input are T=(x, y), and the effective size of the device surface is W×H, then we can first normalize them: u = x / W v = y / H Tn = (u, v) The purpose of normalization is to make the mapping logic independent of a fixed size or ratio.
[0032] Step 2: Basic Rotation Mapping Based on the valid input direction state C, perform a rotation mapping on the normalized coordinates: If C = C0 (positive state), then T1 = (u, v) If C = C1 (90-degree rotation state), then T1 = (v, 1-u) If C = C2 (rotation 180 degrees), then T1 = (1-u, 1-v). If C = C3 (rotation 270 degrees), then T1 = (1 - v, u) This step is used to solve problems such as "the equipment being held upside down, switching between horizontal and vertical orientations, and rotating the entire unit".
[0033] Step 3: Mirror Correction Mapping When the system determines that mirroring correction is needed based on grip information or double-sided information, mirroring is then performed on T1: If a left-right mirror image is required, then T2 = (1 - u1, v1). If a vertical mirror image is required, then T2 = (u1, 1 - v1). Where T1 = (u1, v1). Mirror correction is applicable to input direction mirroring issues caused by changes in the input face after flipping, subjective left-right reversal due to switching between left and right hands, and input direction mirroring caused by special grip methods.
[0034] Step 4: Grip Compensation Mapping If the device has curved surfaces, an ergonomic shape, or is held with one hand, simple rotation and mirroring are insufficient to achieve the best input feel. This embodiment further incorporates a grip compensation feature: T3 = T2 + Δhold Δhold can be determined based on at least one of the following: grip center of gravity offset, surface curvature parameters, shape parameters, or thumb operating area position. The grip compensation may include translation compensation, local nonlinear compensation, or operating comfort zone correction.
[0035] Step 5: Pattern-related mapping T3 is not the final output; different mappings need to be performed depending on the mode. Pointer mode: S = Fpointer(T3) Text mode: K = Fkeyboard(T3) In other words, direction mapping is unified first, and mode mapping is then split.
[0036] Example 4: Two-sided interaction and input main face determination Reference Figure 4 This embodiment describes the specific logic of the two-sided interactive linkage judgment. In the two-sided interactive embodiment, both the first surface and the second surface can provide interactive information. The control processing unit determines which side is the main input surface, which side is the main gripping surface, whether the device has been flipped, whether the user is currently holding the device with their left or right hand, and whether the current gripping method is a wrap-around grip, pinch grip, support grip, or two-handed grip by comparing the total contact area, contact center of gravity, edge contact offset, and contact point movement intensity of the two surfaces.
[0037] The control processing unit does not activate input solely based on the side facing the user, but rather distinguishes between the surface carrying active input and the surface carrying gripping contact based on the surface interaction state. For example, when the first surface detects a small-area, short-duration, high-intensity contact, while the second surface detects a large-area, long-duration, low-intensity contact, the first surface can be designated as the primary input surface, and the second surface as the primary gripping surface. If the device is flipped over and operated by the other hand, the control processing unit re-determines the primary input surface, the primary gripping surface, and the corresponding mirror image relationship.
[0038] Example 5: Compensation Logic for Curved Surfaces and Ergonomic Shapes Reference Figure 10 This embodiment describes the compensation logic when the outer surface of the device is curved or ergonomically shaped. Curved or ergonomic shapes alter the user's actual contact projection on the surface, thus requiring geometric compensation.
[0039] For example, for a slightly curved outer surface along its length, assuming the surface curvature is κ, the longitudinal compensation of the normalized coordinates can be expressed as: v' = v + α·κ·(v-0.5) For a local palm-fitting curved surface along the width direction, the lateral compensation is set as follows: u' = u + β·shape_bias Where α and β are compensation coefficients, and shape_bias is related to shape parameters, grip state and contact center of gravity.
[0040] The aforementioned geometric compensation can be used as an optional compensation step in the orientation adaptive mapping link to correct touch projection deviations caused by curved surfaces, arc surfaces, or ergonomic shapes.
[0041] Example 6: Four-Edge Sensing and Grip Recognition This embodiment describes the edge sensing structure of the first, second, third, and fourth edges and their collaborative relationship with grip recognition. In a certain reference coordinate system, the four edges can be respectively identified as the top edge, bottom edge, left edge, and right edge. E1, E2, E3, and E4 are defined as representing the contact intensity or contact density of the four edges, respectively.
[0042] The control processing unit can assist in determining the grip state, the input main surface, and the current valid input direction state based on the contact strength or contact density of at least two edges. For example, if the contact strength of the first edge is consistently high and the central active operation point is mainly distributed in the opposite side area, it can be determined as a one-handed grip state; if the contact strength of both opposite edges is high at the same time and the central active operation is less, it can be determined as a two-handed grip state.
[0043] Example 7: Specific Logic of Pointer Pattern This embodiment describes the specific interaction logic in the pointer mode, which preferably adopts the touchpad logic that users are already familiar with, so as to reduce learning costs.
[0044] Single-finger sliding corresponds to cursor movement: Δu = u(t)-u(t-1) Δv = v(t)-v(t-1) Δsx = kx·Δu Δsy = ky·Δv Wherein Δu and Δv are coordinate increments after direction mapping and compensation are completed.
[0045] Click determination: A touch is determined as a click when the following conditions are satisfied: contact time t_contact<Ttap; displacement d_move<Dtap; the contact area falls within the range of a fingertip; and there is no large-area false touch characteristic caused by holding.
[0046] Drag determination: A touch is determined as a drag when the following conditions are satisfied: contact time t_contact≥Thold; a continuous movement track with consistent direction occurs subsequently; direction update is frozen during dragging.
[0047] Scroll determination: In a two-finger operation, a scroll amount is output according to the average displacement direction of the two fingers: ScrollY = ks·mean(Δv_two_fingers) ScrollX = ks·mean(Δu_two_fingers) Preferred gestures further include: single-finger tap corresponds to click, single-finger pressing followed by sliding corresponds to drag, two-finger tap or preset gesture corresponds to right click, and three-finger gesture corresponds to mode switching, back operation or task switching.
[0048] Eighth Embodiment: Specific Logic of Text Mode This embodiment describes the specific interaction logic in the text mode. The present invention supports a text input mode. In a solution with a screen, the device itself can display a nine-grid input interface, a small QWERTY input interface, pinyin strings, English strings and candidate words; in a solution without a screen, the device body mainly undertakes functions of touch input and feedback, and an external host undertakes functions of text display and candidate word display.
[0049] The key point is that: in text mode, the interpretation is performed on the area after direction correction, rather than the area in the original orientation of the device.
[0050] In the screenless solution, the surface is preferably divided into a nine-grid area. The area numbers, after direction mapping, are used to generate Pinyin encoding (Chinese input) or nine-key English / T9 encoding (English input). Candidate words are displayed by the local display unit or an external host.
[0051] Optionally, the control processing unit divides the normalized coordinates after direction mapping into N input areas, generates a key code sequence based on the area number where the touch point falls, and sends the key code sequence to the local input method module or the external host input method module to generate candidate words. Text input can use nine-key Pinyin input, nine-key English input, T9 input, or a mini keyboard.
[0052] Swipe right: Confirm the current candidate word or space Swipe left: Delete Swipe up: Scroll up to see more candidates Scroll down: scroll down to see the candidates The preferred screenless solution uses a 9-grid / T9 input method and predictive text input to reduce the cost of blind operation.
[0053] Example 9: State Machine Logic for Mode Switching Reference Figure 6 This embodiment describes the state machine logic for switching between pointer mode and text mode.
[0054] Set of mode states: M0: Standby mode M1: Pointer Mode M2: Text Mode M3: Switch Confirmation Status The trigger condition for entering text mode: Preferred trigger conditions include: a two-finger long press on the center area for more than Tmode; or a three-finger preset switching gesture being executed; or an edge combination gesture being executed.
[0055] After being triggered, the system does not switch immediately. Instead, it first enters the M3 switching confirmation state to confirm that all of the following conditions are met: the current state is not dragging; the current state is not scrolling; the directional stability is greater than the threshold; and there is no large-scale accidental touch. Once all conditions are met, the system switches to M2.
[0056] The conditions for triggering the return pointer mode are: Preferred conditions include: long press with two fingers to exit; three-finger return gesture; continuous idle time exceeding Tidle; and explicit exit action being recognized.
[0057] Mode switching anti-accidental touch mechanism: Mode switching includes trigger judgment and confirmation judgment. Trigger judgment is used to determine whether the mode switching candidate gesture is valid, and confirmation judgment is used to determine whether the directional stability, drag state, scroll state, and accidental touch state meet the switching conditions in the confirmed switching state. During dragging, scrolling, or continuous text input, the control processing unit may pause updating the current valid input direction state and / or pause the execution of mode switching. Optionally, drag locking has a higher priority than directional re-judgment, mode switching confirmation has a lower priority than dragging and scrolling, and re-initialization is allowed after all surfaces are released.
[0058] This embodiment describes a stability control mechanism for orientation states.
[0059] Direction lock: The preferred orientation state is to be locked in the following scenarios: during dragging; during scrolling; during continuous text input; and during switching confirmation states.
[0060] Switching hysteresis: A new direction candidate state is only entered when the stability condition is continuously satisfied for more than Tenter; the current direction is only exited when the stability is lower than Texit. This avoids boundary jitter caused by small changes in attitude.
[0061] Reinitialization: The orientation state can be reinitialized if the system detects the following events: brief weightlessness of the device; the device being put down and then picked up again; complete reversal of the relationship between the two principal surfaces and drastic change in attitude; and re-establishment of surface contact after all surfaces have been released.
[0062] Example 10: Mode Switching Trigger Unit and Pure Touch Mode This embodiment describes the specific implementation of the mode switching trigger unit and its collaborative relationship with the pure touch mode. The device further includes a mode switching trigger unit, which comprises at least one of a physical button, a pressure-sensitive area, an edge touch area, a preset touch gesture, or an external host command. The control processing unit responds to the mode switching trigger unit, switching between pointer mode, text mode, and / or pure touch mode.
[0063] In pure touch mode, the control processing unit stops or pauses outputting key code sequences and candidate word confirmation signals to the input method module, and interprets touch input as pointer movement, clicking, dragging, scrolling, or system control signals. Optionally, the control processing unit outputs status commands to the local display unit or external host to hide, collapse, or disable the text input interface. The feedback unit can output corresponding haptic and / or audible feedback when the mode switch takes effect.
[0064] As an alternative, the mode switching trigger unit can also be implemented through software commands or shortcut keys on an external host, such as triggering mode switching through the status bar icon, global shortcut key, or accessibility menu on the host. This method does not depend on the physical structure of the device itself and is suitable for thin and light designs where the device itself has no additional physical buttons.
[0065] Example 11: Collaboration between Voice Input Trigger Unit and AI Input This embodiment describes the specific implementation of the voice input triggering unit and its collaborative relationship with the AI input function. The device further includes a voice input triggering unit, which comprises at least one of a physical button, a pressure-sensitive area, an edge touch area, a preset touch gesture, or an external host command. The control processing unit responds to the voice input triggering unit, initiates the voice input state, and acquires voice information through the audio acquisition unit of the device itself or the audio acquisition unit of the external host.
[0066] The control processing unit or external host software sends the voice information to the local speech recognition module, the external host speech recognition module, or the cloud speech recognition / artificial intelligence processing module to generate text input results and / or control commands, and outputs the text input results to the current text input position, the input method module, or the application.
[0067] When voice input begins, ends, is recognized, or is canceled, the feedback unit outputs corresponding tactile and / or auditory feedback. Optionally, the voice input triggering unit and the aforementioned mode switching triggering unit can reuse the same physical structure, and the triggering function can be distinguished by different operation methods (such as short press, long press, double click) to save device structural space.
[0068] As an alternative, the voice input triggering unit can also be implemented entirely by software shortcut commands of an external host. The device itself only receives voice start commands from the host via Bluetooth or wireless communication. The device itself does not necessarily have audio acquisition capabilities. This approach is suitable for cost-sensitive or extremely lightweight device forms.
[0069] Example 12: Coupling of Feedback Unit and Input Logic This embodiment describes the specific implementation of the feedback unit and its coupling relationship with the input logic. In this embodiment, the feedback unit includes a haptic feedback structure, preferably a linear motor. In other embodiments, other haptic structures capable of providing a sense of confirmation, rhythm, or simulated click may also be used. The feedback unit may also work in conjunction with a sound unit to output key tones, prompts, or simulated click sounds.
[0070] When the control processing unit confirms states such as click, drag-and-lock, mode switch confirmation, candidate word confirmation, or accidental cancellation, the feedback unit outputs tactile and / or auditory feedback associated with the corresponding state. The feedback unit is not limited to a specific type of linear motor, actuator, or sound-generating device, as long as it can provide distinguishable state feedback.
[0071] The following example, using a complete usage scenario, illustrates how the modules of this invention work together.
[0072] The user picks up a round, double-sided touch device from the table, with the device in an inverted position (face down). The posture sensing unit detects that the device has been picked up and rotated, while the surface interaction acquisition unit detects that: the first surface (the original front) has no contact or only a small amount of edge contact; the second surface (the original back) detects a large area of thumb contact and index finger sliding on the surface.
[0073] Based on this, the control processing unit determines that the second surface is the primary input surface and the first surface is the primary grip surface. Combining the posture information, it determines that the current valid input direction is "the second surface is facing the user and the user's thumb is on the left side," inferring that the user is holding the device with their left hand. The system rotates the touch coordinates of the second surface by 180° for mapping, ensuring that the user's finger swipe direction is consistent with the cursor movement direction on the screen.
[0074] When a user wants to input text, they perform a three-finger swipe gesture. The system enters M3 switching confirmation mode, and after confirming that the direction is stable and not dragging, it switches to text mode. The feedback unit outputs two short vibrations as confirmation. Without looking at the device, the user completes text input by relying on the memory of the nine-grid area and the vibration confirmation from the feedback unit.
[0075] When the user flips the device to use the other side, the system automatically re-determines the input side and the grip side, updates the valid input direction, and the user can continue operating without any manual settings.
[0076] Example 13: Alternative Example Without departing from the core idea of this invention, the following alternative embodiments are also possible: The surface interaction acquisition unit can be a capacitive touch array, a pressure sensing array, an edge sensing structure, a touch display integrated structure, or other structures capable of acquiring surface interaction states.
[0077] The attitude sensing unit can use different combinations of inertial devices, as long as it can obtain information reflecting the spatial state of the device.
[0078] The feedback unit can be a linear motor, other haptic feedback structures, a sound unit, or a combination thereof, and is not limited to a single device solution.
[0079] The device can have only single-sided interaction, or it can have double-sided interaction, multi-area interaction, or double-sided display touch integrated interaction.
[0080] The device can be flat, curved, partially curved, arc-shaped, or ergonomic, as long as it can still perform non-directional handheld input.
[0081] Text input can be done using a 9-key Pinyin key, a 9-key English key, T9, a small QWERTY key, or other layouts suitable for compact input.
[0082] Optional additional sensing structures such as proximity, distance, and thermal status can be added to enhance pre-wake-up, scene recognition, or thermal management capabilities.
[0083] The form of the device is not limited to a single geometric structure. It can be circular, rounded square, rounded rectangle, mobile phone-like, long strip or strip shape, as well as flat, curved, curved, partially curved or ergonomic shape.
[0084] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.
Claims
1. A omnidirectional handheld touch input device, characterized in that, include: A surface interaction acquisition unit is used to acquire surface interaction status information of at least one outer surface of the device. An attitude sensing unit is used to collect the attitude information of the device. A control processing unit is configured to generate a basic orientation candidate state based on the posture information, determine an input main surface and / or a gripping main surface based on the surface interaction state information, and modify the basic orientation candidate state based on the input main surface and / or the gripping main surface and at least one of a flipping state, a left-right hand state, or a gripping mirror state to obtain an orientation candidate state. The control processing unit is further configured to determine the current valid input direction state based on the stability confirmation result of the direction candidate state, and perform direction adaptive mapping on the original touch coordinates based on the current valid input direction state to obtain the target input coordinates; The output unit is used to output pointer control signals and / or text input signals according to the target input coordinates; The current valid input direction state is the direction state used to map the original touch coordinates to the target output coordinate system, and is not a direct mapping of the device's physical orientation.
2. The omnidirectional handheld touch input device according to claim 1, characterized in that, The surface interaction state information includes at least two of the following: contact area, contact centroid, contact duration, contact point motion intensity, contact distribution, and edge contact offset. The control processing unit is used to determine the input main surface and / or the gripping main surface based on at least two of the contact area, contact duration, contact motion intensity, and edge contact bias of each outer surface; wherein, when the contact area of the first outer surface is greater than the area threshold, the contact duration is greater than the duration threshold, and the contact motion intensity is less than the motion threshold, the first outer surface is determined to be the gripping main surface; when the contact motion intensity of the second outer surface is greater than the motion threshold and the contact area is less than the area threshold, the second outer surface is determined to be the input main surface.
3. The omnidirectional handheld touch input device according to claim 1, characterized in that, The control processing unit is used to calculate the orientation stability score and confirm the current valid input orientation state when the orientation stability score meets the preset confirmation conditions; the orientation stability score is determined by at least two of the following: attitude stability degree, surface interaction consistency, candidate state duration, and motion disturbance degree. The degree of attitude stability is determined based on the change in attitude angle within a preset time window. The consistency of surface interaction is determined based on the proportion of the input main surface and / or the gripping main surface remaining consistent within a continuous sampling period. The degree of motion disturbance is determined based on the change in angular velocity or acceleration.
4. The omnidirectional handheld touch input device according to claim 1, characterized in that, The control processing unit is used to lock the current valid input direction state during dragging, scrolling, continuous text input, or mode switching confirmation; and adopts a hysteresis switching mechanism to control the switching of direction state, wherein a new direction candidate state is confirmed after continuously meeting the entry conditions for more than a first time duration, and the current valid input direction state exits after the stability is lower than the exit threshold.
5. The omnidirectional handheld touch input device according to claim 1, characterized in that, The orientation adaptive mapping includes at least performing rotation transformation on the normalized touch coordinates based on the current valid input orientation state; when the control processing unit determines that there is a flip state, left and right hand state, or grip mirror state, it further performs mirror correction transformation; when the outer surface of the device is a curved surface, arc surface, partially curved surface, or ergonomic shape, it further performs geometric compensation transformation. The geometric compensation transformation includes at least one of longitudinal compensation, lateral compensation, local nonlinear compensation, or grip offset compensation, and the geometric compensation transformation is determined based on at least one of surface curvature parameters, shape parameters, grip center of gravity offset, or thumb operation area position.
6. The omnidirectional handheld touch input device according to claim 1, characterized in that, The device includes a first surface and a second surface arranged opposite to each other. The surface interaction acquisition unit acquires surface interaction state information of the first surface and the second surface respectively. The control processing unit determines at least one of the following states based on the difference in interaction states of the first surface and the second surface: input main surface, holding main surface, flipping state, and left and right hand state. The device further includes edge sensing structures for a first edge, a second edge, a third edge, and a fourth edge. The edge sensing structures are used to collect the contact intensity or contact density of at least two edges. The control processing unit uses the information collected by the edge sensing structures to help determine at least one of the following: grip state, input main surface, and current effective input direction state.
7. The omnidirectional handheld touch input device according to claim 1, characterized in that, The device also includes a feedback unit, which is used to output tactile feedback and / or sound feedback associated with the corresponding state when the control processing unit confirms at least one of the states of click, drag lock, mode switch confirmation, candidate word confirmation or accidental cancellation. The device also includes a voice input triggering unit, which includes at least one of a physical button, a pressure sensing area, an edge touch area, a preset touch gesture, or an external host command; the control processing unit responds to the voice input triggering unit, initiates the voice input state, and collects voice information through the audio acquisition unit of the device itself or the audio acquisition unit of the external host. The control processing unit or external host software sends the voice information to the local voice recognition module, the external host voice recognition module, or the cloud voice recognition / artificial intelligence processing module to generate text input results and / or control commands, and outputs the text input results to the current text input position, the input method module, or the application. When voice input begins, ends, is completed, or is canceled, the feedback unit outputs corresponding tactile feedback and / or sound feedback.
8. The omnidirectional handheld touch input device according to claim 1, characterized in that, The control processing unit is used to switch between pointer mode, text mode and optional pure touch mode; the mode switching includes trigger judgment and confirmation judgment, the trigger judgment is used to determine whether the mode switching candidate gesture is valid, and the confirmation judgment is used to determine whether the directional stability, drag state, scroll state and accidental touch state meet the switching conditions in the switching confirmation state. The device further includes a mode switching trigger unit, which includes at least one of a physical button, a pressure-sensitive area, an edge touch area, a preset touch gesture, or an external host command; the control processing unit responds to the mode switching trigger unit and switches between pointer mode, text mode, and optional pure touch mode. In pure touch mode, the control processing unit stops or pauses the output of key code sequences and candidate word confirmation signals to the input method module, and interprets touch input as pointer movement, clicking, dragging, scrolling or system control signals; the control processing unit is also used to output status commands to hide, collapse or disable the text input interface to the local display unit or external host.
9. A direction-adaptive method for a non-directional handheld touch input device, characterized in that, Includes the following steps: Obtain the device's attitude information; Acquire surface interaction state information of at least one outer surface of the device; Generate candidate states of basic orientation based on the attitude information; The input main surface and / or the gripping main surface are determined based on the surface interaction state information; Based on the input main face and / or the gripping main face and at least one of the flipping state, left and right hand state or gripping mirror state, the basic direction candidate state is modified to obtain the direction candidate state. The current valid input direction state is determined based on the stability confirmation result of the candidate direction state, and the current valid input direction state is locked during the preset operation phase. Based on the current valid input direction state, perform adaptive direction mapping on the original touch coordinates to obtain the target input coordinates; Output pointer control signals and / or text input signals based on the target input coordinates.
10. The orientation adaptive method according to claim 9, characterized in that, The orientation adaptive mapping includes: normalizing the original touch coordinates; performing rotation transformation based on the current valid input orientation state; performing mirror correction transformation when the mirror condition is met; performing geometric compensation transformation when the surface or ergonomic compensation condition is met; and converting the mapped coordinates into pointer control commands or text input commands based on the current interaction mode.
Citation Information
Patent Citations
Instruction input and protection method integrating touch screen and behavior sensing
CN104049759A