Differential touch method based on texture recognition

CN119013652APending Publication Date: 2024-11-22HANGZHOU XIXIAO INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380029279.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-03-23
Filing Date
2023-03-22
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing touch command input form is single, resulting in weak functionality and difficulty in meeting the growing functional requirements of portable devices.

Method used

A differential touch method based on texture recognition is adopted. By selecting transmission parts with texture recognition function to connect to electronic devices, information carriers with different textures are used to generate independent signals to achieve diversified user events and command inputs.

Benefits of technology

It enriches the means of interaction between people and electronic devices, increases the touch dimension, improves the functionality of electronic devices, supports the input of multiple information carriers and command sequences, and can complete multiple interaction options without switching fingers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119013652A_ABST
    Figure CN119013652A_ABST
Patent Text Reader

Abstract

The invention provides a difference touch method based on texture recognition, and belongs to the technical field of information interaction. The method comprises the following steps: selecting a transmission piece with a texture recognition function, electronic equipment and information carriers with different textures; the different textures of the information carrier are correspondingly matched with the texture identification information of the transmission piece, so that an independent signal can be generated when the different textures touch or touch the transmission piece; when any one or more information carriers touch or touch the information receiving position of the transmission piece, the transmission piece collects the texture on each information carrier and carries out matching; according to the matching result, the transmission piece generates a corresponding signal and sends the signal to the electronic equipment; and the electronic equipment executes the corresponding instruction or instruction sequence according to the signal content, the software and hardware state of the electronic equipment and / or the input of the transmission piece input by the user. According to the method, the problem of poor functionality caused by single instruction input form of an existing touch mode is solved, and the interaction means between people and the electronic equipment is enriched.
Need to check novelty before this filing date? Find Prior Art

Description

A differential touch method based on texture recognition Technical Field

[0001] The present invention belongs to the technical field of information interaction and relates to a differential touch method based on texture recognition. Background Art

[0002] Today is an era of diversified information. Big data, multimedia, and artificial intelligence are the main trends of the development of the times. However, they are inseparable from an important key factor, that is, the information interaction process.

[0003] What is the information interaction process? For example, when a person uses an electronic device (such as a mobile phone or tablet) and presses their finger on the touchscreen at the desired location, the human body transmits information to the device, causing it to respond to the user's request. In this process, the human body actively sends information to the device by pressing the finger on the desired location; and the device actively responds to the user's request, which is the information interaction between the device and the human body.

[0004] With the gradual development of mobile platforms, small portable devices such as smart bracelets and smart watches have emerged (miniaturization of portable devices), while smartphones, tablets, and other portable devices are increasingly taking on the functions of personal computers (multifunctionalization of portable devices). The smaller screens of small devices like smart bracelets and smart watches limit the smooth operation of touch controls, and the touch control and other operating methods used in portable devices such as smartphones and tablets are increasingly unable to meet the growing demand for more functions in portable devices.

[0005] Commonly used touch methods include the Home button, power button, function keys on the back of the body, some touch screens and / or sensors below, local function keys, touchpads, etc.; the information interaction process between people and electronic devices using existing touch methods is relatively simple. Generally speaking, only one user event will be generated, and occasionally only two commands will be provided (for example, Huawei's mobile phone systems in 2020 and later, quickly and continuously tapping the screen will generate a screenshot function).

[0006] This is like the earliest mouse which only had one click button, and clicking in a specific place would only generate one user event; but with the development of the times, the mouse now has multiple buttons (such as left-click button, right-click button, middle button, and some high-end mice also have back button, forward button, etc. on both sides). In this case, the mouse acts as an information input medium, and clicking different key positions in specific places will generate multiple commands (for example, like clicking "Computer" in the Windows 7 operating system, clicking the left-click button once selects "Computer", clicking the left-click button twice in succession and quickly opens "Computer", and clicking the right-click button once expands the properties interface of "Computer"). This design is very in line with the development trend of the times and can meet user needs, so almost all mice nowadays have at least three command buttons (left-click button, right-click button, middle button).

[0007] Therefore, a differential touch method based on texture recognition is proposed, which diversifies the information interaction instructions between people and electronic devices based on the existing touch method, so as to improve the functionality of electronic devices. Summary of the Invention

[0008] The present invention aims to address the problem that the existing touch control method has a single instruction input form, resulting in weak functionality, and propose a differential touch control method based on texture recognition.

[0009] The present invention includes the following process:

[0010] Step (1): selecting a transmission component and an electronic device with a texture recognition function, and connecting the transmission component to the telecommunication signal of the electronic device;

[0011] Step (2): selecting information carriers with different textures, and matching the different textures of the information carriers with the texture identification information of the transmission member, so that each of the different textures will generate an independent signal when touching or contacting the transmission member;

[0012] Step (3): When any one or more information carriers touch or bump against the information receiving portion of the transmission component, the transmission component collects the texture on each information carrier and performs matching:

[0013] When the texture information collected by the transmission element matches the texture recognition information in the transmission element / electronic device, the transmission element generates corresponding signals and sends them to the electronic device;

[0014] In the case that the texture information collected by the transmission member does not match the texture recognition information in the transmission member / electronic device, the transmission member generates a corresponding signal and sends it to the electronic device;

[0015] When there is no texture input, the transmission component generates a corresponding signal and sends it to the electronic device;

[0016] Step (4): The electronic device executes the corresponding instruction or instruction sequence according to the signal content, the hardware and software status of the electronic device, the transmission input of the user and / or the touch input of the touch screen.

[0017] In particular, when the transmission member is a touch screen with a texture recognition function, the touch input is input by the transmission member.

[0018] The signals include empty signals and real signals; the instructions include empty instructions and real instructions with execution functions; and the instruction sequences include empty instruction sequences and real instruction sequences with execution functions.

[0019] The electronic devices include multimedia devices that carry one or more of text, sound, image, animation, and video for interactive functions, such as smart bracelets, smart watches, mobile phones, computers, tablet computers, and car tablet computers.

[0020] The information carrier is any combination of one or more of a human finger fingerprint, a fingertip with lines on the end, and a touch pen with lines on the end.

[0021] The information carrier is a human finger fingerprint, and the texture recognition function of the transmission part is a finger fingerprint recognition function; different fingerprints are entered and recorded through the transmission part; when the information receiving part of the transmission part is touched or touched, the transmission part collects the finger fingerprint, matches the collected finger fingerprint with the finger fingerprint recorded in the transmission part, generates a corresponding signal and sends it to the electronic device.

[0022] The texture recognition function of the transmission member can also be a finger fingerprint part recognition / classification function; when the information receiving part of the transmission member is touched or touched, the transmission member collects the fingerprint image and distinguishes the finger part, generates a corresponding signal and sends it to the electronic device.

[0023] The information carrier is a fingertip for wearing on a human finger. The end of the fingertip has textures, and the texture information on the fingertip is recorded and recorded through a transmission component. When the information receiving part of the transmission component is touched or touched, the current fingertip texture is collected through the transmission component, and the collected fingertip texture is matched with the fingertip texture recorded in the transmission component, and a corresponding signal is generated and sent to the electronic device.

[0024] The different patterns are respectively arranged on different finger sleeves, or a plurality of patterns are arranged at different positions on the same finger sleeve.

[0025] The information carrier is a touch pen, and the end of the touch pen has texture. The texture information of the end of the touch pen is recorded and recorded through a transmission member. When the information receiving part of the transmission member is touched or touched, the texture of the current end of the touch pen is collected through the transmission member, and the collected texture of the end of the touch pen is matched with the texture of the end of the touch pen recorded in the transmission member, and a corresponding signal is generated and sent to the electronic device.

[0026] The transmission member is any one or a combination of the Home button, power button, function keys on the back of the body, part of the touch screen and / or the sensor below, part function keys, touch screen, and touchpad with texture recognition function.

[0027] Compared with the existing technology, this method changes the form in which traditional transmission parts can only output a single signal, and combines the original touch operation with texture recognition, so that electronic devices under the same software and hardware status will respond differently to touches of different textures in the same position, increasing the dimension of touch; using multiple information carriers to transmit multiple signal functions enriches the means of interaction between people and electronic devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] FIG1 is a flow chart of an implementation method of Example 1. DETAILED DESCRIPTION

[0029] The technical solutions of the present invention are further described below, but the present invention is not limited to these embodiments.

[0030] For the convenience of describing the touchpad as the transmission component in this embodiment, the touchpad can be replaced with one or more combinations of the Home button, power button, function keys on the back of the body, part of the touch screen and / or sensors under the touch screen, part function keys, and touch screen to achieve the same effect. Example 1

[0031] The information carrier is a human finger fingerprint, and the texture recognition function of the touch panel is a finger fingerprint recognition function; different fingerprints are input and recorded through the touch panel; when the information receiving part of the touch panel is touched or touched, the touch panel collects the finger fingerprint, matches the collected finger fingerprint with the finger fingerprint recorded in the touch panel, generates a corresponding signal and sends it to the electronic device.

[0032] As shown in Figure 1, the specific process is as follows:

[0033] Fingerprint recognition is achieved by building a fingerprint library. All fingerprints are recorded into the touchpad or electronic device through the touchpad. The touchpad collects the currently input fingerprint and matches it:

[0034] ① When the texture information collected by the transmission element matches the texture recognition information in the transmission element / electronic device, the transmission element generates corresponding signals and sends them to the electronic device;

[0035] ② In the event that the texture information collected by the transmission element does not match the texture recognition information in the transmission element / electronic device, the transmission element generates a corresponding signal and sends it to the electronic device;

[0036] In particular, when there is no texture input, the touch panel generates a corresponding signal and sends it to the electronic device;

[0037] Partial fingerprint means registering fingerprints of different parts of the finger (such as fingertips, fingerpads, etc.) as separate textures; full fingerprint means registering the fingerprint of the entire finger as the same texture.

[0038] The electronic device executes the corresponding instruction or instruction sequence according to the signal content, the software and hardware status of the electronic device and / or the touch panel input input by the user.

[0039] The fingerprint recognition algorithm (such as the template matching algorithm) used by the fingerprint recognition function will classify fingerprints according to the three basic fingerprint types (scoop-shaped patterns, bucket-shaped patterns, or arc-shaped patterns) when registering / entering fingerprints, map the specific details of tiny patterns, examine the subtle differences in pattern direction caused by pores and edge structures, and generate a fingerprint template in the form of a mathematical representation based on the above fingerprint features; when recognizing a fingerprint, the fingerprint sensor will again capture the fingerprint features in the fingerprint image, create a mathematical representation of the captured fingerprint, and match it with the registered fingerprint template.

[0040] The touchpad's texture recognition function can also be used to identify and classify fingerprint locations. When the touchpad's information receiving area is touched or touched, the touchpad captures the fingerprint image and identifies the finger location, generating and sending corresponding signals to the electronic device. The electronic device then executes the corresponding command or command sequence based on the signal content, the electronic device's hardware and software status, and / or the user's touchpad input.

[0041] For example, a fingerprint with a bucket-shaped pattern can be abstracted as a set of concentric ellipses with varying radii. The ellipses at the fingertips have a larger radius and smaller curvature, while the ellipses at the fingerpads have a smaller radius and larger curvature. This same principle holds true for the vast majority of fingerprints (scoop-shaped, bucket-shaped, and double bucket-shaped). Therefore, simply by calculating the average curvature of the fingerprint's primary ridges in a fingerprint image captured by a touchpad, it's possible to distinguish between fingertips and fingerpads, without requiring fingerprint pre-entry, while achieving the same human-computer interaction experience.

[0042] In terms of recognition efficiency, fingerprint recognition algorithms that use template matching algorithms often need to collect several feature points and compare them with fingerprint templates containing dozens of them; finger fingerprint part recognition / classification algorithms only need to collect and compare one or a few features of the curvature feature of the fingerprint image, which reduces matching time and improves recognition efficiency.

[0043] However, since the finger fingerprint part recognition / classification algorithm only divides fingerprints into two or a few categories, the degree of derivability of its instructions is less than that of the fingerprint recognition algorithm, which can derive more instructions.

[0044] When using fingerprint recognition algorithms, the fingertips and pads of different fingers can also be registered as different textures. This allows multiple interaction options to be integrated on a single finger, similar to fingerprint part recognition / classification algorithms, allowing users to complete input of multiple interaction options without switching fingers. This also provides more interaction options. Example 2

[0045] The information carrier is a fingertip for wearing on a human finger. The end of the fingertip has a texture. The texture information on the fingertip is recorded and recorded via a touchpad. When the information receiving area of ​​the touchpad is touched or touched, the touchpad collects the current fingertip texture, matches the collected fingertip texture with the fingertip texture recorded on the touchpad, generates a corresponding signal, and sends it to the electronic device. The electronic device executes the corresponding instruction or instruction sequence based on the signal content, the hardware and software status of the electronic device, and / or the touchpad input input by the user.

[0046] The different patterns are respectively arranged on different finger sleeves, or a plurality of patterns are arranged at different positions on the same finger sleeve.

[0047] This approach is more in line with current technology, as the fingerprint sleeves are factory-installed with the touchscreen's information, ensuring a perfect match. Furthermore, because the texture of the fingerprint sleeves is regular, fingerprint recognition is easier than fingerprint recognition. Compared to recording human fingerprints, this approach offers greater recognition efficiency and practicality.

[0048] The finger sleeve can also have a two-segment or multi-segment structure. For example, the texture of the finger sleeve at the fingertip is different from the texture of the finger sleeve at the fingertips, thereby achieving the feature of "completion of input of multiple interactive options without switching fingers". Example 3

[0049] The information carrier is a stylus with a textured end. The touchpad records and records the texture information on the stylus end. When the information receiving area of ​​the touchpad is touched or tapped, the touchpad captures the texture information on the stylus end. The captured texture information is then matched with the texture information recorded on the touchpad, generating a corresponding signal and sending it to the electronic device. The electronic device then executes a corresponding instruction or instruction sequence based on the signal content, the hardware and software status of the electronic device, and / or the touchpad input from the user.

[0050] The two ends of the touch pen have two different textures. After the texture information recorded by the touchpad is matched with the textures at both ends of the touch pen, the two commands obtained are: open and switch to the next step execution command, and back and switch to the previous step execution command. Example 4

[0051] To implement any combination of 1 to 3, multiple information carriers are used as input.

[0052] Using the method described in the above embodiment, the following forms of human-computer interaction are listed for example regarding how to use various command forms:

[0053] In different systems or applications, specific instructions and instruction sequences are specified by their developers / users.

[0054] The following textures include fingerprints, patterns on fingertips, and patterns on styluses.

[0055] Form 1:

[0056] When the input texture collected by the transfer component is the designated texture, the first instruction / instruction sequence is executed; when the input texture collected by the transfer component is not the designated texture, the second instruction / instruction sequence is executed.

[0057] Form 2:

[0058] Assume that m textures are recorded in the transmission device / electronic device.

[0059] When the input texture collected by the transmission component is the texture corresponding to the nth instruction or instruction sequence, the electronic device executes the nth instruction or instruction sequence, where n is less than or equal to m.

[0060] When the input texture collected by the transfer component is not the recorded m textures, the electronic device executes the (m+1)th instruction or instruction sequence.

[0061] For example, the transfer member is a touchpad where all touch areas support texture recognition function;

[0062] For example, in a certain drawing software, the first instruction is expressed as a brush tool, the second instruction is expressed as an eraser tool, and the third instruction is expressed as a selection tool. When the input texture collected by the touchpad is the texture corresponding to the second instruction, the drawing software will erase the painting traces in the touch area.

[0063] Form 3:

[0064] The working state of the touch operation is determined by the texture collected by the transmission element; it is usually a two-handed operation, with one hand acting as an information carrier and the other hand acting as a touch input for the touch screen.

[0065] For example, in a certain drawing software, when the index finger of the left hand touches the transmission part (the transmission part collects the fingerprint of the index finger), the software is in the "erase execution" state; when the middle finger of the left hand touches the transmission part (the transmission part collects the fingerprint of the middle finger), the software is in the "perspective switch execution" state; when the drawing software is not in the "erase execution" and "perspective switch execution" states, it is in the "drawing execution" state.

[0066] When neither the index finger nor the middle finger of the left hand is placed on the transfer element, the software is in the "drawing execution" state. At this time, the touch operation in the drawing area with the right hand is interpreted as "drawing" (brush function);

[0067] When the left index finger is continuously placed on the transfer element, the software is in the "erase execution" state, then the touch operation in the drawing area with the right hand is interpreted as "erasing" (eraser function);

[0068] When the left middle finger is continuously placed on the differential touch control, the software is in the "perspective switching execution state", then the touch operation in the drawing area with the right hand is interpreted as "moving the canvas";

[0069] This format is well compatible with the non-full-screen fingerprint and texture recognition devices that are widely available on the market. For example, there are many smartphones in the market that have texture recognition modules integrated into the home button, power button, function keys on the back of the body, below some touch screens, and other function keys.

[0070] Form 4: Combine Form 1, Form 2, and Form 3.

[0071] Form 5: Based on Form 4, combined with other touch methods:

[0072] The designated texture in form 1 is simply referred to as texture A, and the texture that is not the designated texture is simply referred to as texture non-A.

[0073] Texture A+single click corresponds to instruction 1, texture non-A+single click corresponds to instruction 2, texture A+double click corresponds to instruction 3, texture non-A+double click corresponds to instruction 4;

[0074] Another example is the use of multi-touch: texture A / non-A with drag, texture A / non-A with zoom

[0075] Another example is the combination of force sensing, texture A / non-A with light pressing and heavy hitting, etc.

[0076] Another example is the form of sliding detection:

[0077] When the user touches the touchpad with texture A, the effect is equivalent to pressing a virtual button. When the user touches the touchpad with texture non-A and moves the touchpad, by detecting the direction and / or distance of movement of the information carrier on the touchpad, the effect is equivalent to pushing a virtual / analog joystick in a specific direction and to a specific degree and / or pressing a linear trigger with varying force. This allows the touchpad to function as a multi-function button, virtual joystick, and / or linear trigger.

[0078] The slide detection function can be achieved by continuously collecting fingerprint images and comparing the offset between images. For example, modern optical mice use the same principle to convert the movement of the mouse on the mouse pad or other textured surface into the movement of the cursor on the screen.

[0079] The above methods and forms are only some of the solutions given in this document. In addition, there are many extensible forms. After the development of future technology, various information transmission forms or communication equipment will also be applicable to the concepts proposed by this invention.

[0080] It should be understood that in the claims and description of the present invention, all "including..." should be understood as open-ended, that is, its meaning is equivalent to "at least containing...", and should not be understood as closed-ended, that is, its meaning should not be understood as "only including...".

[0081] The specific embodiments described herein are merely illustrative of the spirit of the present invention. Persons skilled in the art may make various modifications, additions, or substitutions to the described specific embodiments without departing from the spirit of the present invention or exceeding the scope of the appended claims.

Claims

1. A differential touch method based on texture recognition, characterized in that: The following processes are included: Step (1): Select a transmission component and an electronic device with texture recognition function, and connect the transmission component to the telecommunication signal of the electronic device; Step (2): selecting information carriers with different textures, and matching the different textures of the information carriers with the texture identification information of the transmission member, so that each of the different textures will generate an independent signal when touching or contacting the transmission member; Step (3): When any one or more information carriers touch or bump against the information receiving portion of the transmission component, the transmission component collects the texture on each information carrier and performs matching: ① When the texture information collected by the transmission element matches the texture recognition information in the transmission element / electronic device, the transmission element generates corresponding signals and sends them to the electronic device; ② In the event that the texture information collected by the transmission element does not match the texture recognition information in the transmission element / electronic device, the transmission element generates a corresponding signal and sends it to the electronic device; In particular, when there is no texture input, the transmission component generates a corresponding signal and sends it to the electronic device; Step (4): the electronic device executes a corresponding instruction or instruction sequence based on the signal content, the hardware and software status of the electronic device, the transmission input of the user and / or the touch input of the touch screen; In particular, when the transmission member is a touch screen with a texture recognition function, the touch input is input by the transmission member.

2. The texture recognition-based differential touch method according to claim 1, characterized in that: The signals include empty signals and real signals; the instructions include empty instructions and real instructions with execution functions; and the instruction sequences include empty instruction sequences and real instruction sequences with execution functions.

3. The texture recognition-based differential touch method according to claim 1, characterized in that: The electronic device includes a multimedia device equipped with one or more of text, sound, image, animation, and video for interactive functions.

4. The texture recognition-based differential touch method according to claim 1, characterized in that: The information carrier is any combination of one or more of a human finger fingerprint, a fingertip with lines on the end, and a touch pen with lines on the end.

5. The texture recognition-based differential touch method according to claim 4, wherein: The information carrier is a human finger fingerprint, and the texture recognition function of the transmission member is a finger fingerprint recognition function; different fingerprints are input and recorded through the transmission member; When the information receiving part of the transmission part is touched or bumped, the transmission part collects the fingerprint of the finger, matches the collected fingerprint with the fingerprint recorded in the transmission part, generates a corresponding signal and sends it to the electronic device.

6. The texture recognition-based differential touch method according to claim 4, wherein: The information carrier is a human finger fingerprint, and the texture recognition function of the transmission part is a finger fingerprint part recognition / classification function; when the information receiving part of the transmission part is touched or touched, the transmission part collects the fingerprint image and distinguishes the finger part, generates a corresponding signal and sends it to the electronic device.

7. The texture recognition-based differential touch method according to claim 4, characterized in that: The information carrier is a fingertip for wearing on a human finger, the end of the fingertip has lines, and the information of the lines on the fingertip is recorded and recorded through a transmission member; When the information receiving part of the transmission part is touched or bumped, the current fingertip pattern is collected through the transmission part, and the collected fingertip pattern is matched with the fingertip pattern recorded in the transmission part to generate a corresponding signal and send it to the electronic device.

8. The texture recognition-based differential touch method according to claim 7, characterized in that: The different patterns are respectively arranged on different finger sleeves, or a plurality of patterns are arranged at different positions on the same finger sleeve.

9. The texture recognition-based differential touch method according to claim 4, wherein: The information carrier is a touch pen, the end of which has textures, and the texture information of the end of the touch pen is recorded and recorded through the transmission member; When the information receiving part of the transmission part is touched or bumped, the texture of the current touch pen end is collected through the transmission part, and the collected texture of the touch pen end is matched with the texture of the touch pen end recorded in the transmission part to generate a corresponding signal and send it to the electronic device.

10. The texture recognition-based difference touch method according to any one of claims 1 to 7 and 9, characterized in that: The transmission member is any one or a combination of the Home button, power button, function keys on the back of the body, part of the touch screen and / or the sensor below, part function keys, touch screen, and touchpad with texture recognition function.